Niklas Elmqvist

Over the last 11 months since #ieeevis 2023, the VIS 2024 Overall Papers Chairs (OPCs)---Tamara Munzner, Holger Theisel, and I---have been carefully documenting the "Road to VIS 2024" in a series of 11 posts on the @ieeevis website. Find them here: https://ieeevis.org/year/2024/blog/index

The goal was to demystify the VIS review process, covering topics from call for papers to final selections. We invited the community to join us in exploring the recently restructured process, aiming for transparency.

Blog

Website for IEEE VIS.

Oct 16, 2024 at 7:54amWeb
Show threadNiklas ElmqvistOct 16, 2024

In our first post, we introduced our plan to demystify the VIS review process. We outlined topics from call for papers to final selections. We invited the community to join us in exploring the recently restructured process, aiming for transparency in what's typically known only to chairs.

Post: https://ieeevis.org/year/2024/blog/road-to-vis-2024-welcome

Show threadNiklas ElmqvistOct 16, 2024

Our second post detailed the process of creating the VIS 2024 Call for Papers. We introduced four key changes:

1. Reducing reviewers per paper from 4 to 3
2. Increasing PC member load from 6 to 8 papers
3. Introducing a selective fast-track to TVCG for rejections
4. Adding an assistant to the OPC team

These aimed to address reviewer fatigue and improve efficiency.

Post: https://ieeevis.org/year/2024/blog/vis-2024-OPC-blog-call-for-papers

The Road to VIS 2024 - The Call for Papers

It’s getting close to the winter break for the Northern hemisphere, and soon those of us who celebrate Christmas will be closing down our email clients and g...

Show threadNiklas ElmqvistOct 16, 2024

January started with a deep dive into the VIS Program Committee. Key points:

- PC shrinking to ~150 members
3-year terms with 1/3 rotating yearly
- PhD required; looking for reliability, expertise, and diversity
- Ways to get noticed: volunteer call, external reviewing

We explained its composition, relationship to areas, and selection process.

Post: https://ieeevis.org/year/2024/blog/vis-2024-OPC-blog-PC

The Road to VIS 2024 - The Program Committee

Happy New Year! It’s 2024 and we, the Overall Papers Chairs for IEEE VIS 2024, are back with another update in our blog series on “The Road to VIS 2024.” Thi...

Show threadNiklas ElmqvistOct 16, 2024

February brought a focus on replication studies:

- Importance of replication in scientific method
- Rarity of replication in vis/HCI (only 3% of papers)
- Challenges: focus on novelty, qualitative results
- Our encouragement for more replication studies
- Plans to guide reviewers on evaluating replications

We hope to see brave authors submit replication work!

Post: https://ieeevis.org/year/2024/blog/vis-2024-OPC-blog-replication

The Road to VIS 2024 - On Replication Studies

The reproducibility and replicability of research is a cornerstone of the scientific method (National Academies 2019). In order for research results—at least...

Show threadNiklas ElmqvistOct 16, 2024

Next, we addressed the hidden costs of paper submissions. Key points:

- Each submission requires ~3 reviewers' unpaid labor
- APCs and OPCs also invest significant time
- Submitting isn't "free"—it costs dozens of volunteer hours
- Authors should review ~3 papers for each submission
- Reviewer fatigue is real; everyone needs to contribute

We encouraged all to volunteer as reviewers!

Post: https://ieeevis.org/year/2024/blog/vis-2024-OPC-blog-cost-of-submission

The Road to VIS 2024 - The Cost of Submission

In this edition of the Road to VIS 2024, we want to tackle the topic of reviewing and reviewer fatigue. We want to shed light on the invisible labor that our...

Show threadNiklas ElmqvistOct 16, 2024

Mid-March, we delved into Conflicts of Interest (COIs):

- COIs affect objectivity (real or perceived)
- Some conflicts never expire (e.g., advisors, family)
- Most expire after 3 years (e.g., co-authors, shared affiliation)
- Reviewers must update COIs in PCS
- PCS now helps identify conflicts, but may be over-enthusiastic
- Accurate COIs crucial for fair review process

This post was prophetic given our later problems with conflicts in the review process.

Post: https://ieeevis.org/year/2024/blog/vis-2024-OPC-blog-handling-conflicts

The Road to VIS 2024 - Handling Conflicts

We’re entering March and the game is heating up! With less than three weeks to go for the VIS 2024 full papers deadline, it is time that we OPCs start turnin...

Show threadNiklas ElmqvistOct 16, 2024

April brought submission stats for VIS 2024:

- 557 full papers from 680 abstracts (82% conversion)
- 3.53% increase from 2023, 21% from 2022
- Most submissions: Applications (154), Theoretical & Empirical (112)
- 143 PC members handling 6-8 papers each

Key dates:
- PC assignments: April 8
- External reviewer invites: April 11
- All reviews due: May 8
- First-round notifications: June 6

Post: https://ieeevis.org/year/2024/blog/vis-2024-OPC-blog-numbers

The Road to VIS 2024 - Submissions by the numbers

March 31 has come and gone, which means that the IEEE VIS 2024 full papers deadline has passed. This is when us OPCs and APCs are starting our work, and when...

Show threadNiklas ElmqvistOct 16, 2024

May update on VIS 2024 review process:

- PC assignments & external reviewer recruitment: April 1-11
- Reviews due: May 8
- 1 week discussion period follows
- APCs triage papers, make preliminary recommendations
- OPCs ensure consistency across areas
- IEEE TVCG gives final approval
- Decisions documented for transparency

Good luck to all authors!

Post: https://ieeevis.org/year/2024/blog/vis-2024-OPC-blog-decisions

The Road to VIS 2024 - From Reviews to Decisions

We get it—waiting is hard. As we move into May, the early June notification date for the outcomes of your submissions seems no closer. Also, it could be that...

Show threadNiklas ElmqvistOct 16, 2024

August update on VIS 2024 decisions:

- 124 papers accepted (22.3% acceptance rate)
- 5 papers rejected in 2nd round
- 3 rejections due to serious conflict of interest violation
- Lesson: Declare ALL conflicts, including permanent ones (advisors/students)
- We're improving processes to prevent future occurrences
- Integrity in peer review is crucial for our community.

Post: https://ieeevis.org/year/2024/blog/vis-2024-OPC-blog-decisions_2

The Road to VIS 2024 - Decisions

With the final acceptance decisions behind us, the official VIS 2024 review process is coming to a close. We felt that it was worth taking a moment now to lo...

Show threadNiklas ElmqvistOct 16, 2024

September reflections on VIS 2024:

- Our past 10 blog posts shared insights on review process

Survey results:
• 47% favor 3 reviewers per paper (will likely continue)
• 74% against 8 papers per PC member (likely reverting to 6)

Future ideas: extended deadline for supplemental material, optional (anonymous) public reviews, student reviewer program

Join the VIS town hall to discuss these and more!

Post: https://ieeevis.org/year/2024/blog/vis-2024-OPC-blog-Reviewing

The Road to VIS 2024 - Reflections on Reviewing

The road to VIS 2024 is coming to an end and our work as OPCs is almost done. In a few short weeks, we will be opening the paper program at the conference an...

Show threadNiklas ElmqvistOct 16, 2024

Final VIS 2024 post: Conference Talks 101
Tips for success:
* Session Chairs: Prep with speakers beforehand; Manage time strictly

Speakers:
* Use ready room to test tech; Respect time limits

Attendees:
* Enter/exit quietly; Ask concise questions, use mic

Remember: Questions show ❤️ for the work!

Post: https://ieeevis.org/year/2024/blog/vis-2024-OPC-blog-Talks

The Road to VIS 2024 - Conference Talks 101

There is an art to orchestrating a successful talk session at any conference, including IEEE VIS. Whether you’re a session chair, speaker, or attendee, this ...

Show threadNiklas ElmqvistOct 16, 2024

We OPCs have valued the chance to speak to the community over the last year. Thank you for your attention and interest!

We also want to extend a huge thanks to Tamara Munzner 👑 for her service these last two years! And we are pleased to welcome Melanie Tory to the VIS 2025 OPC team!

See you at the Town Hall---Wednesday October 16 at 3pm EDT! /end