How to use BigQuery with Pollfish data

Pollfish’s massive audience means a potentially massive amount of data to be analyzed. For clients running higher-volume surveys, our Enterprise plan often works best, and now it includes the ability to integrate Pollfish data directly with Google’s BigQuery database for easier, faster data analysis. 

integrate-bigquery-pollfish

 

What is BigQuery?

Bigquery is Google’s answer to cloud-based data storage. It’s especially beneficial to those looking to segment and analyze large quantities of data rapidly. 

The “serverless” model saves on set-up costs associated with complete server systems as well as offers high-speed updates and more opportunities to integrate with existing BI tools. BigQuery also uses a columnar storage design that makes it easy to run SQL queries with their AI optimizing the datasets in nearly real-time.

There’s no question that this is a massive aid to researchers working with high volume datasets who can’t risk their information becoming outdated in the time that it takes to process it properly. 

Benefits of integrating BigQuery with Pollfish

BigQuery is where researchers can store, segment, and analyze their data from anywhere, but where they pull that information from is a different story. The tool makes this easy by offering the ability to integrate with data collection and analytics tools like Tableau, Looker, Data Studio, and most recently— Pollfish! 

This integration allows us to push all existing and future survey data from your Pollfish account to your Google BigQuery database in real-time, including the survey demographics, questionnaire content, respondent profiles, and actual responses. 

The implementation includes a ready-to-use query view that can be instantly applied to easily view and segment your Pollfish data. 

What this means is that our Enterprise clients who use BigQuery can connect their Pollfish data directly to their database. 

How to connect BigQuery and Pollfish

Please note that you must have a billing account with BigQuery and be on an Enterprise plan with Pollfish in order to integrate. Click here to visit BigQuery pricing.

      1. Begin by logging into your Google Cloud Platform account, or creating one if you do not have one yet.
      2. Go to “Console” and create or select the project that you want to use. Tip: Keep track of the project ID. In our example, the project ID is “big-query-test-252108bigquery-export-id
      3. From the left navigation pane, select APIs & Services—> Credential
      4. Once the Credentials page is displayed, select the Create credentials tab and choose Service Account Key from the listed options.select-service-account
      5. Assign the role BigQuery—>BigQuery Data Owner to the account.
      6. Add a name for the service account. In our example, the account is “pollfish-bigdata-exporter.”
      7. Click “Create” and the service account file will be created and downloaded to your computer.bigquery-assign-data-owner
      8. For the last step, send the JSON file and the Project ID from step 2 to your account manager who will enable the BigQuery export on your account.

Historical data from past Pollfish surveys can also be exported to BigQuery. Just reach out to support to activate.

How to use Pollfish data in BigQuery

When your Pollfish surveys are exported, they will appear in seven BigQuery tables. Each table describes an element of the survey and the collected responses. 

In addition, the data is generated in a single view showing a flat representation of the complete dataset and how it is all related in the database.

From this view, you can query the tables and pull out the information you need from your questionnaire’s content, respondent demographics, and actual responses.

sql-table

How do I get BigQuery on my Pollfish plan?

Pollfish only offers the BigQuery integration on Enterprise plans. Enterprise clients enjoy this feature at no additional cost, as well as a variety of other benefits tailored to high-volume client needs, such as additional seats for team members, lower CPIs, and dedicated account management. 

To learn more about Pollfish service plans, visit our pricing page to compare options and choose the right fit for you. To upgrade your account to an Enterprise plan, contact sales@pollfish.com