We have dozens on integrations that we support, and they can all be in different statuses due to the development cycles and the amount of testing we've done with them.
Due to the complex nature of smart contracts and the different layering of the protocols to interact with other protocols, it is difficult to account for these edge cases and thus we are always trying to make sure our integrations are working for most of the user wallets that have interacted with the protocol.
We employ a variety of tests to help troubleshoot issues to ensure that we have enough confidence about the data validity of the integration, from manual testing, to unit tests and integration tests. Furthermore, we also run our integration against a randomized set of live users using the integration and then check for errors to ensure an acceptable error rate.
Here are the different statuses that we have for our integrations:
Alpha Stage
At this stage we are still testing out the integration. The integration has passed based on our tests accounts that have interacted with the protocol, and we are continuing our work on running automated tests and spot checks with live accounts. There could still be issues at this point that we would need to address.
Criteria to pass Alpha Stage
E2E Tests - All the E2E tests passed (6 test wallets)
Manual QA (test wallets) - Checking the test positions (snapshot, snapshot day data, onDemand)
Minisite test (if applicable) - Checking the test positions on the minisite
Mass indexing - indexing (snapshots, onDemand data) and e2e test error rates are below 8% (ignore low-cap price issues, ignore 3rd party farm interactions)
Round 1: 300 wallets
Round 2: 800 wallets
Round 3: 1500 wallets
Beta Stage
At this stage we have ran the integration against our test accounts and have ran integration tests to ensure that the values are acceptable. At this stage however we might still see some issues pertaining to certain wallets and/or complex smart contracts that interacted with the integration.
Criteria to pass Beta Stage
Manual QA (test wallets) - Checking the test positions (snapshot, snapshot day data, EOD, dependent, onDemand)
Minisite test (if applicable) - Checking the fully populated test positions on the minisite
Mass indexing - indexing (EOD and dependent data) and e2e test error rates are below 3%
Round 1: 300 wallets
Round 2: 800 wallets
Round 3: 1500 wallets
Manual QA (spot checks) - 3-5 randomly selected positions checked and passing QA
All User data indexed - All the day data and dependent day data are indexed
Client feedback - No client issue reported after being live for 2 months
Please check the Available Protocols page for an up to date status for each of the integrations we support