example(refiner): added new connector for refiner connector #437

fivetran-sushmitha · 2025-10-31T18:15:26Z

Jira ticket

Closes <ADD TICKET LINK HERE, EACH PR MUST BE LINKED TO A JIRA TICKET>

Description of Change

Business value and revenue impact

This Refiner connector directly helps Fivetran customers unlock survey analytics at scale:

Customer feedback analytics

Problem - Companies rely on manual CSV exports to analyze survey responses.
Solution - Automated connector syncs survey and response data keyed by user ID, ready for analysis in BI tools.
Revenue impact - Opens new market segment (customer feedback analytics); supports product and marketing analytics customers.

User-level insights

Problem - Product and growth teams cannot easily correlate survey responses with user behavior data.
Solution - Connector enables joining survey data with product usage in the warehouse via user ID.
Revenue impact - Drives adoption among SaaS and growth teams using Refiner to measure user satisfaction and NPS.

Operational efficiency

Problem - Manual exports are time-consuming and error-prone.
Solution - Fivetran automation eliminates manual work and ensures consistent incremental syncs.
Revenue impact - Strengthens positioning in the feedback automation space, increasing customer retention and cross-sell opportunities.

Testing

<MENTION ABOUT YOUR TESTING DETAILS HERE, ATTACH SCREENSHOTS IF NEEDED (WITHOUT PII)>

Checklist

Some tips and links to help validate your PR:

Tested the connector with fivetran debug command.
Added/Updated example specific README.md file, refer here for template.
Followed Python Coding Standards, refer here

github-actions · 2025-10-31T18:15:50Z

🧹 Python Code Quality Check

✅ No issues found in Python Files.

🔍 See how this check works

This comment is auto-updated with every commit.

Copilot

Pull Request Overview

This PR adds a new Refiner Survey Analytics Connector that integrates with the Refiner API to sync NPS survey data, responses, and user information into Fivetran destinations. The connector implements incremental syncs with cursor-based pagination, proper error handling, and comprehensive state management.

Key changes:

New connector implementation with 5 normalized tables (surveys, questions, responses, answers, respondents)
Incremental sync support based on last_data_reception_at timestamps with configurable start dates
Comprehensive error handling with exponential backoff and proper retry logic for transient failures

Reviewed Changes

Copilot reviewed 3 out of 3 changed files in this pull request and generated 9 comments.

File	Description
connectors/refiner/connector.py	Main connector implementation with API integration, pagination, state management, and data transformation logic
connectors/refiner/configuration.json	Configuration template with API key and optional start date parameters
connectors/refiner/README.md	Complete documentation covering setup, features, authentication, data handling, and table schemas

connectors/refiner/connector.py

connectors/refiner/README.md

connectors/refiner/connector.py

Copilot

Pull Request Overview

Copilot reviewed 3 out of 3 changed files in this pull request and generated 5 comments.

Comments suppressed due to low confidence (1)

connectors/refiner/connector.py:28

Import of 'urlencode' is not used.

from urllib.parse import urlencode

connectors/refiner/connector.py

connectors/refiner/README.md

connectors/refiner/connector.py

connectors/refiner/README.md

fivetran-chinmayichandrasekar

@fivetran-sushmitha Left a few suggestions. Thanks.
Also, the main Readme.md file is missing.

connectors/refiner/README.md

fivetran-sahilkhirwal

Please address these comments as well as copilot comments :)

connectors/refiner/connector.py

fivetran-sahilkhirwal · 2025-11-06T12:54:54Z

Please link the example to the main README
Also, there are some flake8 issues present. Please resolve them as well
You can check the flake8 issue report here

…_sdk into refiner

Copilot

Pull Request Overview

Copilot reviewed 4 out of 4 changed files in this pull request and generated 17 comments.

connectors/refiner/configuration.json

connectors/refiner/connector.py

connectors/refiner/README.md

connectors/refiner/connector.py

connectors/refiner/README.md

README.md

connectors/refiner/connector.py

fivetran-chinmayichandrasekar

LGTM. Please address the review comments from Copilot.

fivetran-chinmayichandrasekar

I have left a suggestion and a comment. Please check. Thanks.

connectors/refiner/README.md

Copilot

Pull Request Overview

Copilot reviewed 4 out of 4 changed files in this pull request and generated 6 comments.

connectors/refiner/README.md

connectors/refiner/connector.py

connectors/refiner/README.md

connectors/refiner/connector.py

fivetran-sahilkhirwal

looks good

fivetran-rishabhghosh

Please wait till tech writer approves it

fivetran-chinmayichandrasekar

Left a couple of suggestions again. Thanks.

connectors/refiner/README.md

Co-authored-by: fivetran-chinmayichandrasekar <chinmayi.chandrasekar@fivetran.com>

fivetran-chinmayichandrasekar

Left a few suggestions. Thanks

connectors/refiner/README.md

fivetran-chinmayichandrasekar

Left a few suggestions. Thanks.

connectors/refiner/README.md

Co-authored-by: fivetran-chinmayichandrasekar <chinmayi.chandrasekar@fivetran.com>

fivetran-chinmayichandrasekar

LGTM

fivetran-chinmayichandrasekar

LGTM

fivetran-chinmayichandrasekar

LGTM

example(refiner): added new connector for refiner connector

b3be037

fivetran-sushmitha requested review from a team as code owners October 31, 2025 18:15

Copilot AI review requested due to automatic review settings October 31, 2025 18:15

github-actions bot added the size/XL PR size: extra large label Oct 31, 2025

fivetran-sushmitha added the hackathon For all the PRs related to the internal Fivetran 2025 Connector SDK Hackathon. label Oct 31, 2025

Copilot AI reviewed Oct 31, 2025

View reviewed changes

fivetran-sahilkhirwal requested review from Copilot, fivetran-rishabhghosh and fivetran-sahilkhirwal October 31, 2025 18:44

Copilot AI reviewed Oct 31, 2025

View reviewed changes

fivetran-dejantucakov requested a review from fivetran-chinmayichandrasekar October 31, 2025 19:40

fivetran-dejantucakov assigned fivetran-chinmayichandrasekar Oct 31, 2025

fivetran-chinmayichandrasekar reviewed Nov 4, 2025

View reviewed changes

fivetran-sahilkhirwal requested changes Nov 6, 2025

View reviewed changes

connectors/refiner/connector.py Show resolved Hide resolved

connectors/refiner/connector.py Outdated Show resolved Hide resolved

connectors/refiner/connector.py Outdated Show resolved Hide resolved

fivetran-sahilkhirwal added the top-priority A top priority PR for review label Nov 10, 2025

fivetran-sushmitha added 2 commits November 18, 2025 13:26

Merge branch 'main' of https://github.com/fivetran/fivetran_connector…

4470051

…_sdk into refiner

Address review comments

6f66966

fivetran-sushmitha requested review from fivetran-chinmayichandrasekar and fivetran-sahilkhirwal November 18, 2025 08:16

fivetran-sahilkhirwal requested a review from Copilot November 18, 2025 08:47

Copilot started reviewing on behalf of fivetran-sahilkhirwal November 18, 2025 08:47 View session

Copilot finished reviewing on behalf of fivetran-sahilkhirwal November 18, 2025 08:51

Copilot AI reviewed Nov 18, 2025

View reviewed changes

fivetran-chinmayichandrasekar previously approved these changes Nov 18, 2025

View reviewed changes

fivetran-chinmayichandrasekar reviewed Nov 20, 2025

View reviewed changes

connectors/refiner/README.md Outdated Show resolved Hide resolved

connectors/refiner/README.md Outdated Show resolved Hide resolved

fivetran-sahilkhirwal requested a review from Copilot November 20, 2025 13:03

Copilot started reviewing on behalf of fivetran-sahilkhirwal November 20, 2025 13:04 View session

fivetran-sushmitha requested a review from fivetran-chinmayichandrasekar November 20, 2025 15:58

fivetran-sahilkhirwal requested a review from Copilot November 20, 2025 18:17

Copilot started reviewing on behalf of fivetran-sahilkhirwal November 20, 2025 18:18 View session

Copilot finished reviewing on behalf of fivetran-sahilkhirwal November 20, 2025 18:20

Copilot AI reviewed Nov 20, 2025

View reviewed changes

fivetran-sahilkhirwal previously approved these changes Nov 20, 2025

View reviewed changes

fivetran-rishabhghosh approved these changes Nov 20, 2025

View reviewed changes

fivetran-rishabhghosh previously approved these changes Nov 20, 2025

View reviewed changes

fivetran-chinmayichandrasekar reviewed Nov 21, 2025

View reviewed changes

connectors/refiner/README.md Outdated Show resolved Hide resolved

connectors/refiner/README.md Outdated Show resolved Hide resolved

Update connectors/refiner/README.md

a9ae0c2

Co-authored-by: fivetran-chinmayichandrasekar <chinmayi.chandrasekar@fivetran.com>

fivetran-sushmitha dismissed stale reviews from fivetran-rishabhghosh and fivetran-sahilkhirwal via a9ae0c2 November 24, 2025 13:52

Update connectors/refiner/README.md

dc0e300

Co-authored-by: fivetran-chinmayichandrasekar <chinmayi.chandrasekar@fivetran.com>

fivetran-sushmitha requested a review from fivetran-chinmayichandrasekar November 24, 2025 13:53

fivetran-chinmayichandrasekar reviewed Nov 25, 2025

View reviewed changes

fivetran-sushmitha and others added 8 commits November 25, 2025 12:50

Update connectors/refiner/README.md

b738db9

Co-authored-by: fivetran-chinmayichandrasekar <chinmayi.chandrasekar@fivetran.com>

Update connectors/refiner/README.md

2cce4ee

Co-authored-by: fivetran-chinmayichandrasekar <chinmayi.chandrasekar@fivetran.com>

Update connectors/refiner/README.md

d7193bd

Co-authored-by: fivetran-chinmayichandrasekar <chinmayi.chandrasekar@fivetran.com>

Update connectors/refiner/README.md

27d6403

Co-authored-by: fivetran-chinmayichandrasekar <chinmayi.chandrasekar@fivetran.com>

Update connectors/refiner/README.md

cb34563

Co-authored-by: fivetran-chinmayichandrasekar <chinmayi.chandrasekar@fivetran.com>

Update connectors/refiner/README.md

6f62a97

Co-authored-by: fivetran-chinmayichandrasekar <chinmayi.chandrasekar@fivetran.com>

Update connectors/refiner/README.md

c7ed243

Co-authored-by: fivetran-chinmayichandrasekar <chinmayi.chandrasekar@fivetran.com>

Update connectors/refiner/README.md

65e50ad

Co-authored-by: fivetran-chinmayichandrasekar <chinmayi.chandrasekar@fivetran.com>

fivetran-sushmitha requested a review from fivetran-chinmayichandrasekar November 25, 2025 07:32

fivetran-chinmayichandrasekar approved these changes Nov 25, 2025

View reviewed changes

fivetran-sushmitha requested review from fivetran-rishabhghosh and fivetran-sahilkhirwal November 25, 2025 14:07

example(refiner): added new connector for refiner connector #437

Are you sure you want to change the base?

example(refiner): added new connector for refiner connector #437

Uh oh!

Conversation

fivetran-sushmitha commented Oct 31, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Jira ticket

Description of Change

Business value and revenue impact

Customer feedback analytics

User-level insights

Operational efficiency

Testing

Checklist

Uh oh!

github-actions bot commented Oct 31, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

🧹 Python Code Quality Check

Uh oh!

Copilot AI left a comment

Choose a reason for hiding this comment

Pull Request Overview

Reviewed Changes

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Copilot AI left a comment

Choose a reason for hiding this comment

Pull Request Overview

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

fivetran-chinmayichandrasekar left a comment

Choose a reason for hiding this comment

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

fivetran-sahilkhirwal left a comment

Choose a reason for hiding this comment

Uh oh!

Uh oh!

Uh oh!

Uh oh!

fivetran-sahilkhirwal commented Nov 6, 2025

Uh oh!

Copilot AI left a comment

Choose a reason for hiding this comment

Pull Request Overview

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

fivetran-chinmayichandrasekar left a comment

Choose a reason for hiding this comment

fivetran-sushmitha commented Oct 31, 2025 •

edited

Loading

github-actions bot commented Oct 31, 2025 •

edited

Loading