How to Use Concept Rules in Your Monadic and Sequential Survey
How to Use Concept Rules in Your Monadic and Sequential Survey
What can I achieve with concept rules?
With concept rules, you can differentiate the follow-up questions a respondent gets and obtain better insights from the test. The evaluation questions of the test will remain the same for all concepts, no logic can be applied within the questions of the test.
By using concept rules in your monadic or sequential test, you can direct the respondent - after he finishes with the evaluation questions, to follow-up questions curated specifically for the concept or concepts he got.
For example, for a monadic test, you can make follow-up comparison questions that test how a respondent perceives the product he saw in comparison to another one.
How do concept rules work?
You can apply concept rules at the AB group, so that when the respondent finishes with the questions of the AB, to be redirected to a specific question outside of the group based on the concept they got.
You can also apply complex rules containing concept rules, in the case you want to combine specific answers from regular questions with concepts shown.
- Add a monadic or sequential test to your survey
- Open the logic page
A. For simple rules:
- Select the question or the ab test group, you want to apply the rules
- In the rule, you can select the “if concept at” and pick the concept you want to apply the rule
- You can add rules for all concepts or for some of the concepts
For example, let’s assume that you want to conduct a monadic test for 3 soft drinks, and have the respondents compare 2 out of these 3 in the case they got one of these 2 in their monadic.
B. For complex rules, combining concepts with answer questions:
i. Select the question or the ab test group, you want to apply the rules
ii. In the rule, you can select the “if concept at” to pick the concept you want to apply the rule, click “Add” and select “if answer at” to pick the question’s answer you want to add.
For example, let’s assume that you want to conduct a monadic test for 2 soft drinks, and drive the respondent to answer a specific follow up question provided that he has also given a specific answer to a regular question (outside of the A/B)
What is the mobile flow a respondent gets with concept rules applied?
For the first case of rules(2a), the respondent will follow the following flow: Pollfish Survey
For the second case of rules(2b), the respondent will follow the following flow:
Or this: Pollfish Survey
Can I combine a sequential test with concept rules?
Yes, for a sequential test, you can apply concept rules with complex logic if needed. For example, you can conduct a sequential test for a respondent to view 2 out of 3 concepts, and based on the concepts he got, make a comparison after the sequential questions finish.
Here you can find how to set up such a sequential test with a follow-up comparison question:
Here you will preview what the respondent gets: Pollfish Survey
How to Do Away with Typos With the Edit Questionnaire Feature
How to Do Away with Typos With the Edit Questionnaire Feature
When forming the questionnaire — the heart of the survey — even the most diligent market researchers are bound to come upon errors. At Pollfish, we’ve created a solution that can nip this issue in the bud without needing to slow down the survey process.
Pollfish has released a new feature that allows researchers to quickly remove typos and correct any text-based errors in all surveys.
With the new Edit Questionnaire feature, researchers can edit their typos and other text if need be, in any survey they choose, regardless if the survey is still running or complete. This creates a much more smooth survey experience for the researchers, as they don’t have to stop a running survey, or even pause it to adjust textual errors.
This article explains how to use the Edit Questionnaire feature and how any market research campaign can benefit from it.
Understanding the Edit Questionnaire Feature
Market researchers have likely caught a typo error in a running survey in the results of a completed survey. Researchers now have the ability to correct typos and edit all text fields regardless of the survey status, thanks to the Pollfish Edit Questionnaire feature.
This includes making the corrections and other textual edits in questions, answers, statements, scale points, concepts, etc.)
This new feature is available to all researchers under all of our plans.
The Edit Questionnaire does not require researchers to make any status changes to the survey they are editing. As such, researchers don’t need to pause, stop or resume any survey they use this feature with.
The Usefulness of the Edit Questionnaire Feature
This feature is useful for virtually any survey research campaign, as it equips market researchers with a handy and practical way of fixing typos without halting or pausing a survey. Typos can occur even among the most meticulous researchers. It isn’t practical to stop a survey or change its status, as this delays the survey process.
The Edit Questionnaire feature is the solution to this pesky issue, as researchers can now fix typos within their running studies and share them with their peers. They can do so without stopping a running survey or duplicating it to launch a copy. They can edit any text while the platform is deploying surveys and extracting responses.
This is useful as it helps researchers make changes as soon as they find them, allowing them to edit their questions as they please.
How to Use the Edit Questionnaire Feature
In line with the Pollfish commitment to user-friendliness, this new feature offers ease of use and efficiency. The following explains how to use the Edit Questionnaire feature on the Pollfish platform.
- On the Pollfish dashboard, go to the surveys and hover over the survey you would like to edit.
- Here, you’ll find the three-dot button that grants you options on changing the survey status and using a feature.
- Click on the three-dot button on the right of the survey you would like to edit.
- A dropdown menu will appear.
- Click on “Edit Questionnaire” and you will be taken to the questionnaire of the survey you clicked on, which you can then edit.
- The ‘’Audience’’ & ‘’Checkout’’ pages will be grayed out.
- Here, you can also apply changes to the ‘’recall information’’ option. The rest of the options at the left panel are grayed out (carry forward, skip logic, etc).
- However, you can review (only) the ‘’apply logic’’ rules per question.
- Select “save changes’’ in the questionnaire page to save any changes you made.
- After clicking on ‘’save changes’, these changes will be reflected on the results page.
- Please bear in mind that there is no ‘’auto-save’’ button.
- When the survey’s status is ‘’Under edit’’ (Edit Audience), the option ‘’Edit Questionnaire’’ is also available.
- If you want to discard your changes, click back and confirm the action.
Creating Quality Surveys
In summary, researchers can improve the quality of their surveys as their surveys are running. They can ward off both their own typos along with those of their respondents. After hitting “save,” the changes become instantly available to respondents and the results.
Thus, using this feature is effective and friction-free.
Remember, as our surveys are running, our online survey platform uses AI and machine learning along with random device engagement (RDE) sampling to ensure the highest quality of responses.
Machine learning performs quality checks that disqualify gibberish and other low-quality answers, those using a VPN. RDE sampling engages digital users across a wide net of digital properties, without pre-recruiting them to take a survey.
The Pollfish platform is, therefore, best equipped to extract and deliver the best results.
How to Use the New Carry Forward Feature for an Enhanced Survey Experience
How to Use the New Carry Forward Feature for an Enhanced Survey Experience
As the heart of any survey, the questionnaire must be contrived carefully so that you receive the responses most necessary for your survey research. Creating the questions themselves can be difficult, especially if you choose to create question paths.
Pollfish is thus thrilled to present a new feature to make building the questions a much easier task: Carry Forward. This new attribute provides advanced piping capabilities to optimize your questionnaire experience.
The Purpose of the Carry Forward Feature
As a refresher, piping is a functionality that allows users to place, aka, “pipe,” a part of a question or answer into a subsequent question or answer.
In the Pollfish platform, piping works by taking the answer(s) from the sender question and inserting them to the receiver question.
In the first piping iteration, researchers were able to funnel answer choices from one question to another based on respondents’ selections. The following question would carry forward answers from previously piped answers.
The new Carry Forward feature carries (no pun intended) the function of enriching the question-building experience, as it allows you to pipe questions on more question and answer types, along with other capabilities.
This new feature helps researchers design specific questions that are more relevant to the respondent’s behavior, and more useful to their research.
It functions on both selected and unselected answers. It also can be used with:
- Matrix questions
- Ranking questions
- Single selection questions
- Multiple selection questions
Laying Out the Carry Forward Capabilities
Multiple Selection Questions
Along with carrying forward selected answers, this feature allows researchers to carry forward all the answers that the respondent did not select.
In the case of a multiple selection question, for example, the feature can carry forward the unselected answers into the receiver question.
Due to this, when a responder selects all the answers and proceeds, there will be no answer to carry forward, as there are no remaining unselected answers. For this precise reason, the Pollfish platform has developed a validation which exists as a dialogue box.
This pop-up allows the researcher to know that the Carry Forward feature cannot support this case, as it only works if at least one answer is unselected. This is due to the condition that unselected answers cannot be carried forward if all the answers have been selected.
Advanced Logic
This can be used in tandem with advanced logic, allowing you to augment your survey with multiple layers.
Enabling advanced logic (ADL) can trigger questions without forwarded answers. For example, when Carry Forward is enabled but a respondent skipped the sender question, the respondent will then be routed to a question without Carry Forward answers
Pollfish has also added front end validation that disables the researchers from proceeding with the previous structure.
Sender questions with either the “None of the above” or “Other” option must be structured correctly, that is, with multiple selection questions. If these aren’t added to the proper question, there will be pop-up error messages.
Carry Forward Answers that Contain Media
If the Carry Forward answer type is the same or similar to the source (question) type, such as:
- single to single,
- multiple to multiple,
- single to multiple, etc.,
then the platform will carry forward the media files together with the answers.
In other cases, such as different types between sender & receiver questions, there are certain conditions and rules that dictate how Carry Forward will work.
How to maneuver Carry Forward answers which contain media:
- If the Carry Forward answer type is the same or similar (single, multiple) to the source type ? the media will be carried forward.
- If the Carry Forward answer type doesn’t support media then:
- The text will be carried forward if the source answer contains both text and media.
- Carry Forward will not be supported if the source answer contains only media.
How to Add Carry Forward to Your Questionnaire
In order to add the Carry Forward feature, you’ll need to enter the questionnaire portion of the survey first (after completing the audience section). You’ll also need to have your questions and answers in mind.
You can add Carry Forward when you begin the questionnaire, as you’ll need at least two questions to use this feature, the sender and receiver question. You can also implement it to an existing questionnaire.
- Find the Carry Forward option at the left panel of the questionnaire.
- Find a sender and a receiver question you wish to apply the CF feature to. This can be in any order. For example, you can use Question 1 as the sender question and Question 2 as the receiver question.
- Enable this via the receiver question and select “Carry Forward” and then the selected or unselected answers from a previous question (the sender question).
What Carry Forward Supports Vs. What It Does Not Support
There are certain conditions that need to be met in order to apply the Carry Forward function. There are certain circumstances in which your questions will not be able to implement Carry Forward.
What it supports:
- Carry Forward can be used with single/ multiple/ ranking/ matrix questions when they are designed as receiver questions.
- When you carry forward a matrix question, there’s an additional option to narrow the choices based on selected columns, unselected columns, rows for selected columns, rows for unselected columns, and columns for specific rows.
- It is supported by single, multiple, open-ended, numeric, ranking, matrix, slider and OE when they are set up as sender questions.
- The researcher can carry forward all the questions that the respondent didn’t select.
- There is simultaneous support of advanced logic and Carry Forward.
- It supports Order/ Shuffle answers for funneling questions.
What it doesn’t support:
- Carry Forward cannot be used with description questions, Net Promoter Score (NPS) surveys and visual ratings surveys.
- It does not support screening questions and therefore cannot be used in them.
- It does not support the option of “Group and Randomize.”
Note: Closing off, you should know that responses that are carried forward will be treated the same as other answer choices on the results page.
We suggest you preview your survey design before submitting the survey itself. Try it out!
Incorporating Multiple Audiences into Your Survey
Incorporating Multiple Audiences into Your Survey
Have you ever needed to create multiple audiences under one sampling pool for your survey research? Now you can, with the new Multiple Audience feature in the Pollfish dashboard.
This feature creates a hyper-targeted audience landscape, allowing you to select various demographics, mobile usage and geolocation criteria — for multiple audience groups. Previously, the platform allowed researchers to select these criteria, but for one audience group only.
The Purpose of the Multiple Audience Feature
With this new feature, you will be able to create separate audiences in one survey and achieve any targeting combination you desire.
Essentially, the feature allows you to apply quotas within the quotas and conditions within conditions. You can also use minimum quotas, in which only a percentage of an audience gets assigned a quota (which you select), while the rest does not and will therefore receive random response types.
This will allow you to achieve a hyper-granular approach to targeting your sampling pool, aka, the survey respondent audience.
Laying Out the Components of the Multiples Audience Feature
The feature includes separate audience blocks that can be customized as you so choose. Each block represents an audience group, i.e., Audience 1, Audience 2, etc. There is no limit to the number of audience blocks you can create, so long as they don’t exceed the total amount of survey completes.
The blocks also present a wide variety of audience category selections. As with the previous single-audience capability, this one allows you to create quotas for each type of demographic, geolocation and mobile usage selection, along with a maximum of 3 screening questions. This is known as layered demographics conditions, which are also called interlocking quotas.
Prior to the update, researchers were able to apply separate quotas to each targeting variable (non-interlocking quotas, or overlapping quotas). For example: in a sample pool of 1,000 respondents, the requirements may be: 500 (50%) men and 500 (50%) women, 500 (50%) young people and 500 (50%) older people. In this instance of non-interlocking quotas, you risk a pool of 500 young men and 500 older women.
Interlocking quotas can avoid this, in which a quota is defined by more than one variable. The interlocking percentage involves multiple variables, for example, household income, gender and age.
In reference to the aforesaid example, you can define a target size for each combination of variables. That means you can mandate 250 young men (50% x 50%) 250 young women, 250 older men and 250 older women. This assures that not only will you get respondents of every variable, but that they are collected evenly (if you so choose with your assigned quotas).
Each audience, regardless of how different will have the same language, as they are each part of one survey, i.e., one sampling pool.
The Pollfish platform will calculate the CPI and feasibility of the survey by taking into account all the conditions of each audience.
How to Create Multiple Audiences
To create multiple audiences and use their various features, follow these steps. Keep in mind that, while they give complete direction in using all the new feature’s functionalities, your survey may go in a different direction. As such, you may not have to follow all the steps enumerated below if you don’t need certain functions and additions.
- Create a new survey.
- You will be taken to the “audience” interface.
- Begin by choosing the number of completes — the maximum number of respondents in the first audience.
- The total completes on the top left will reflect how much completes you have by adding up the completes in each audience block.
- Start with the age and gender criteria. Select the subcategories your survey is targeting. Add quotas to each subcategory (male or female, or within the age ranges).
- Next, move onto the screening questions portion and add three questions that pertain most to your survey (a maximum of 3 per survey, meaning a maximum of 3 no matter how many audiences you add).
- Decide which criteria to use for this particular audience, as you can choose various subcategories under demographics, geolocation, mobile usage and even advertising ID.
- By enabling this criterion, all responses of the survey will be accompanied by the respondent’s advertising ID (in an Excel sheet export).
- Once you decide which criteria to use, apply quotas. You may add more or less completes to Audience 1, just make sure you don’t use up the total completes.
- After setting up your first audience, click on the + icon on the bottom of the Audience 1 block.
- This will open up a new audience group, aka, block.
- Follow steps 2-6 for your next audience selections.
- Follow step 7 should you wish to add more audiences.
- Review the entire audience section. Check the total completes to ensure you’re going to enlist the correct amount or respondents in the platform.
- Also, make sure the audience blocks are all feasible.
- If a block is not feasible, adjust the targeting design of the audience related to a ''not feasible'' estimation to make it feasible. You can expand the targeting, remove quotas or filters.
- You’re all set with Multiple Audiences and the audience section at large; you can now move on to the questionnaire.
This new feature will allow you to hyper-target your survey to befit a wide variety of segments in your target market, or any of your subject of interest.