Auto Generation Of Tests
Toll Gate | Description | Benchmark | Test cases/ Documentation |
---|---|---|---|
Functional | Test cases are created for each feature and executed to ensure the feature is working as expected. Once all the issues are resolved, features will be signed off for production. | 100% of the must do bugs need to be fixed | Service-wise Signoff StatusStudent App & Web Test Cases List of Issues in the Student App |
Performance | This test is to stress test the system and understand how many users the service can support. Latency and Throughput numbers as per the attached sheet. | 100% of the APIs that are not under | Beta API – Prod EnvironmentPerformance testing for 10 million DAUs |
Security | Security checks ensure that user data, platform and content is protected against attackers who are trying to gain admin access of our platform and cause damage. | 100% of the must do issues need to be fixed 4 must fix and another 12 good to fix vulnerabilities | Vulnerability Test Scenarios Vulnerability Details |
UI/UX | This measures how easy is the product to use and user-friendly our product is. Every screen is checked to ensure design parity is maintained. | 100% of the must do bugs need to be fixed | UI/UX Test Cases |
Cross Browser | In order to ensure the product runs smooth on all the browsers, the top 5 browsers covering 95% of the traffic in different screen resolutions are tested. The last 3 versions for each browser is also to be covered in the testing. The major browsers as per the GA data are:Google ChromeSafariFirefoxEdgeSamsung Internet BrowserAll of these browsers are tested for both desktop and responsive mobile browsers in various devices. | 100% of the must do bugs need to be fixed | Service-wise Signoff StatusStudent App & Web Test Cases List of Issues in the Student App |
Cross Device/ Cross OS | As we want every student holding a mobile to be able to download and use our mobile apps seamlessly, we have covered the devices that cover 95% of the users based on brands as per the Google analytics data.We also make sure the different Android/iOS versions are supported. The target for Android is 6 (Marshmallow and above). For iOS, 13 and 14 versions across the devices ranging from iPhone 7 to iPhone 12 are tested. | 100% of the must do bugs need to be fixed | Service-wise Signoff StatusStudent App & Web Test Cases List of Issues in the Student App |
Algorithms | Algorithms are part of our product and test cases are written and executed to ensure the algorithms are working as expected | 100% of the must do bugs need to be fixed | Student App & Web Test Cases |
Measurability | In order to trace the user access paths and understand the user behaviour, we implement events on every action the user performs on our platform. These events are tested to ensure they are triggering correctly on the actions performed | 100% of the events need to be captured correctly and dashboards need to be made available for tracking | Events Wiring |
SEO | SEO helps us to improve the customer experience, increase our domain authority, drive more people to our site, get an edge over the competition, and increase conversions, and get more loyal customers, and more growth for our website. | NA in Phase – I as the users will be given access after their email ID/ mobile numbers are whitelisted | |
Content | We are committed to serve only academically correct and consumable content to our students. We ensure the content is thoroughly reviewed before publishing it to production. | 100% of the questions in the Published status |
QA Engineers – Manual:
Automation Team (SDET):