To do card sorting with remote participants, use a digital card sorting tool to send studies directly to participants who complete them on their own devices from any location. This approach eliminates geographical limitations and scheduling conflicts while maintaining the core benefits of traditional card sorting research. Remote card sorting allows you to gather valuable insights about how users categorize and understand your content structure without the need for in-person sessions.
Key Takeaways
- Time required: 2-3 hours setup + 3-5 days for participant completion
- Difficulty: Beginner
- What you need: Digital card sorting tool, participant list, and 20-40 content cards
- Key tip: Provide clear instructions upfront since you can't clarify questions in real-time
What You'll Need
- List of 20-40 content items or concepts to test
- 8-15 remote participants (target users)
- Free Card Sort account (free at freecardsort.com)
- Clear study objectives and success criteria
Step 1: Set Up Your Digital Card Sort Study
Create your card sorting study using a dedicated online platform that handles remote participant management automatically. Digital card sort tools provide the interface, data collection, and analysis features needed for remote research. Set your study parameters including participant requirements, completion timeframe, and any demographic screening questions.
Pro tip: Choose an open card sort for exploratory research or a closed card sort when you want to test existing category labels.
Step 2: Prepare Your Content Cards
Write clear, concise labels for each piece of content you want participants to categorize, ensuring each card represents a single concept or page. Your cards should use language your target users understand, avoiding internal jargon or technical terms that might confuse participants. Aim for 20-40 cards total, as fewer cards won't provide enough data while more cards create participant fatigue.
Example: Instead of "CRM Integration Documentation," use "Connecting Customer Management Systems" for better user comprehension.
Step 3: Write Detailed Study Instructions
Craft comprehensive instructions that explain the card sorting process, expected time commitment, and study purpose since participants won't have a moderator present to answer questions. Include a brief example or practice round to demonstrate how the sorting interface works. Clear instructions reduce participant confusion and improve data quality significantly.
Pro tip: Test your instructions with a colleague first to identify any unclear language or missing steps.
Step 4: Recruit and Invite Remote Participants
Send personalized invitations to your target participants with the study link, completion deadline, and estimated time requirement (typically 15-30 minutes). Remote card sorting works best with 8-15 participants per user segment, providing enough data for pattern recognition without overwhelming your analysis. Include incentives when appropriate to improve participation rates.
Pro tip: Send reminder emails 2-3 days before your deadline to participants who haven't completed the study yet.
Step 5: Monitor Participation and Send Reminders
Track completion rates through your card sorting platform's dashboard and follow up with non-respondents after 48-72 hours. Remote studies typically see 60-80% completion rates when properly managed with timely reminders. Monitor for any technical issues participants might report and be ready to provide support via email.
Pro tip: Set up automatic reminder emails in your card sorting tool to save time on manual follow-ups.
Step 6: Analyze Results and Identify Patterns
Review the similarity matrix and dendrograms generated by your card sorting tool to identify which cards participants consistently grouped together. Look for cards that were sorted into the same categories by 60% or more of participants, as these represent strong content relationships. Pay attention to cards that were frequently miscategorized or created confusion among participants.
Pro tip: Focus on the strongest patterns first (80%+ agreement) before analyzing more ambiguous groupings.
Step 7: Create Your Information Architecture
Use the card sorting results to build or refine your website's navigation structure, placing strongly-associated content items within the same categories or sections. Document both the clear patterns and the problematic areas that need additional research or design consideration. Create a new site map or navigation system that reflects how your users naturally think about your content.
Pro tip: Validate your new information architecture with tree testing to ensure the structure works in practice.
Pro Tips
✅ Keep cards concise: Use 2-4 words per card to prevent participants from overthinking their sorting decisions.
✅ Test across devices: Ensure your card sorting study works properly on both desktop computers and mobile devices since remote participants use various setups.
✅ Set realistic deadlines: Give participants 5-7 days to complete the study, accounting for different schedules and time zones.
✅ Provide context: Include a brief explanation of your website or product so participants understand the sorting context.
Common Mistakes to Avoid
❌ Skipping instruction testing: Unclear instructions lead to inconsistent data and participant frustration when no moderator is available for questions.
❌ Using too many cards: Studies with 50+ cards see significantly higher dropout rates and lower-quality sorting decisions.
❌ Recruiting wrong participants: Generic participants produce less actionable results than users who actually need your content.
❌ Ignoring mobile users: Many remote participants will complete your study on mobile devices, so ensure your tool provides a good mobile experience.
Frequently Asked Questions
How long does it take to do card sorting with remote participants?
Remote card sorting typically requires 2-3 hours for setup and participant recruitment, then 3-5 days for completion, and 2-4 hours for analysis. Participants spend 15-30 minutes completing the actual sorting exercise, but the overall study timeline depends on your participant recruitment method and response rates.
What tools do I need to do card sorting with remote participants?
You need a digital card sorting platform like Free Card Sort, OptimalSort, or UsabilityHub that handles remote participant management, provides an intuitive sorting interface, and generates analysis reports. Free Card Sort offers unlimited studies and participants at no cost, making it ideal for getting started with remote card sorting research.
What are the most common mistakes when conducting remote card sorting?
The biggest mistakes include writing unclear instructions (since no moderator is present), using too many cards (causing participant fatigue), and recruiting participants who don't match your target users. Poor mobile optimization also reduces completion rates since many remote participants use mobile devices.
How do I know if my remote card sorting results are good?
Look for clear patterns where 60-80% of participants grouped the same cards together, completion rates above 70%, and reasonable sorting time (15-30 minutes per participant). Strong results show distinct content clusters with minimal overlap and few cards that participants consistently struggled to categorize.