Smart Assessment Engqine - Icanio Technology
To become the most trusted brand for undergrad students to empower them to enter the professional & academic world
Solution
Built their learning management and student workflow Management system to handle about 10000 students in 12 months.
Services
Web based services
Business Type
Enterprise
Location
Bangalore, Karnataka
Leveraging AI to Enhance Communication Analysis and Streamline Feedback for Students
Problem:
Traditional interview evaluations often involve human biases, high operational costs, and the inability to assess diverse English accents accurately. These limitations hinder the ability of educational institutions, organizations, and EdTech companies to deliver consistent, scalable, and timely feedback. Furthermore, the resources required for manual evaluations can be significant, making it difficult to maintain high standards while scaling processes effectively.
For example, manual evaluation may result in inconsistent scoring due to human subjectivity, leaving room for errors or bias. Additionally, in a remote learning or work environment, it becomes increasingly challenging to ensure the integrity of assessments, especially when traditional methods fail to capture real-time feedback or monitor cheating attempts.
For example, manual evaluation may result in inconsistent scoring due to human subjectivity, leaving room for errors or bias. Additionally, in a remote learning or work environment, it becomes increasingly challenging to ensure the integrity of assessments, especially when traditional methods fail to capture real-time feedback or monitor cheating attempts.
Agitation:
The challenge becomes even more pronounced when considering how traditional evaluation methods aren't scalable, are labor-intensive, and offer limited feedback. In the context of the rapidly growing EdTech industry and the shift towards remote learning, there is an increasing need for tools that can provide real-time, unbiased feedback without compromising on quality.
Evaluators spend a significant amount of time reviewing student responses manually, which leads to delays in providing actionable feedback. In many cases, it’s also difficult to maintain exam integrity in remote or automated settings. Given the global diversity of English speakers, assessing students with different accents further complicates the evaluation process, leaving traditional methods inadequate for today’s educational needs.
Evaluators spend a significant amount of time reviewing student responses manually, which leads to delays in providing actionable feedback. In many cases, it’s also difficult to maintain exam integrity in remote or automated settings. Given the global diversity of English speakers, assessing students with different accents further complicates the evaluation process, leaving traditional methods inadequate for today’s educational needs.
Solution:
The Smart Assessment Engine is a state-of-the-art, AI-powered tool that addresses the challenges of traditional interview evaluations by automating and optimizing the assessment of communication skills. This solution leverages advanced AI algorithms and IRIS-based eye-tracking technology to ensure that interviews are not only conducted efficiently but also provide detailed and accurate feedback to students in real time.
Designed specifically for scalability, the Smart Assessment Engine reduces the need for manual intervention, lowers operational costs, and provides a reliable mechanism for evaluating communication skills. Through frequent practice sessions, real-time feedback, and a robust training model, this tool empowers educators and evaluators to make more informed, unbiased decisions. It also helps to assess diverse English accents, ensuring that students from various linguistic backgrounds are fairly evaluated, no matter their dialect or accent.
Designed specifically for scalability, the Smart Assessment Engine reduces the need for manual intervention, lowers operational costs, and provides a reliable mechanism for evaluating communication skills. Through frequent practice sessions, real-time feedback, and a robust training model, this tool empowers educators and evaluators to make more informed, unbiased decisions. It also helps to assess diverse English accents, ensuring that students from various linguistic backgrounds are fairly evaluated, no matter their dialect or accent.
Key features of the Smart Assessment Engine include:
- Automated Communication Skill Assessments: The tool assesses the clarity, fluency, and correctness of language used by the student.
- Accent Recognition: By training AI models with various English dialects, it provides accurate evaluation of diverse accents.
- Real-Time Feedback: Students receive instant feedback on their performance, helping them to improve their communication skills faster.
- Exam Integrity Monitoring: Utilizing IRIS technology, the tool can detect potential cheating by tracking the student’s eye movements, ensuring the integrity of the assessment process.
Solution Implementation
The Smart Assessment Engine is powered by a robust AI system that works in tandem with sophisticated tracking and linguistic algorithms. Below are the detailed implementation processes:
1. Model Training for Accent Recognition:
- Challenge: One of the key hurdles in language-based assessments is accurately understanding diverse English accents. A system that cannot properly understand different accents will fail to provide reliable feedback.
- Solution: To overcome this, we worked closely with language experts and linguists to train our AI system on a variety of English accents from across the globe. This training involved feeding the AI with data from speakers with different regional dialects, from American to British, Australian, and even non-native English speakers with unique accents. By incorporating this vast array of voices into the training model, the engine is now capable of accurately identifying and understanding multiple accents, ensuring that students are evaluated fairly, regardless of their origin or linguistic background.
2. Eyeball Tracking Design for Exam Integrity
- Challenge: With the rise of online learning and remote interviews, ensuring exam integrity is becoming increasingly difficult. Traditional methods of monitoring students during exams often fail to provide adequate supervision, leaving room for dishonest behavior.
- Solution: We incorporated IRIS technology into the system, which tracks the student’s eye movements during the assessment. By observing patterns in the student’s gaze, the AI can flag potential misconduct, such as looking away from the screen for too long or glancing at external materials. This ensures that the integrity of the exam process is maintained while providing accurate, real-time data on the student’s behavior during the assessment.
3. Language Processing Rules for Vocabulary and Grammar:
- Challenge: Evaluating communication skills involves understanding the nuances of language, including vocabulary, grammar, and syntax. Without a structured framework, AI may struggle to evaluate these aspects accurately.
- Solution: We developed a structured set of linguistic rules that focus on key components of effective communication, including vocabulary usage, grammar accuracy, sentence structure, and fluency. The system uses these rules to evaluate the student's speech or writing, providing specific, actionable feedback. For example, if a student makes a grammatical error or uses a word incorrectly, the AI will highlight the mistake and offer suggestions for improvement. These rules also enable the engine to score students on different aspects of their communication proficiency, such as clarity, fluency, and lexical resource.
Project Introduction
It is an EdTech Startup based out of Bangalore. They are primarily in the higher education space and provide students with preparatory courses for competitive exams like GMAT, GRE, IELTS and TOEFL. In addition, they also assist students with profile building and admissions consulting activities that could make their study abroad application stronger. The brand was delivering these courses on an SD Card that would operate in a specific application on a tablet.
- Since that added to their overheads, the organisation wanted to create a custom Learning Management System that would host their course content.
- In addition, they also had a lot of data on their students which they would use to manage the student workflow.
- Hence, they also wanted a platform that could help them simplify their workflow processes.
What we have received from client
- Learning Management System to host video content, quizzes and student journey.
- Data Management Portal to capture student data and manage the various stages of the student journey.
The teams needed were as follows
The various users used this platform
End Users
Students and clients - These would be the people who are consuming the content and attempting the quizzes on the portal and the platform.
Admin Users
Operations Teams, Associates, Mentors and Teachers - These would be the people who are managing the student journey. They are mainly from the Operations and Customer Support Team.
Super admin Users
Operations Teams, Associates, Mentors and Teachers - These would be the people who are managing the student journey. They are mainly from the Operations and Customer Support Team.
Challenges & Solutions
KEY CHALLENGES
SOLUTIONS
The requirements for the Data Management System
kept changing from time to time.
Set up a strict Agile Project Management System and educate all the stakeholders about the same so that the requirements are more streamlined.
Since the content was for test preparation, the
student journey could be perceived as long, boring and uninteresting.
student journey could be perceived as long, boring and uninteresting.
The Learning Management System tried to gamify the experience by providing various levels and by including an interactive UI.
The logic of the GMAT and GRE scoring system was unique and was not readily available to be replicated.
Regular brainstorming sessions were conducted with Academic Experts and Product Managers to break down the logic and a similar logic was built for the tests.
KEY CHALLENGES
The requirements for the Data Management System
kept changing from time to time.
Since the content was for test preparation, the
student journey could be perceived as long, boring and uninteresting.
student journey could be perceived as long, boring and uninteresting.
The logic of the GMAT and GRE scoring system was unique and was not readily available to be replicated.
SOLUTIONS
Set up a strict Agile Project Management System and educate all the stakeholders about the same so that the requirements are more streamlined.
The Learning Management System tried to gamify the experience by providing various levels and by including an interactive UI.
Regular brainstorming sessions were conducted with Academic Experts and Product Managers to break down the logic and a similar logic was built for the tests.
Learning Management System (LMS)
Setting Up
The student first enters personal information and the details regarding the proposed date on which the test will be taken.
Goal Setting
Additional details such as dream score, target college and the timeline are captured.
Personalized Plan
Then the platform customises the study plan based on the inputs given by the student.
Learning Phase
The student watches the concept videos and takes the topic test.
Practice & Reinforcement
The student then practises further using drill and question bank questions.
Performance Tracking
The LMS tracks the performance of the student on each of the sections and gives inputs accordingly.
Reporting & Monitoring
Teachers and mentors will be able to pull out student performance and progress reports at the backend.
Data Management Portal
Profile Setup
The student enters personal information and preferences.
Student Onboarding
The student then attends the onboarding process on the portal.
Schedule a Mentor Call
Once the onboarding is done, the student then schedules a call with the mentor using the calendar option on the portal.
Post - Call Review
Post-call reports and summaries can be seen in the portal.
Back end Reporting
Managers and Operations Associates will be able to pull our stage-wise and student performance reports at the backend.
Managing a large-scale student cohort: The impact of LMS and data management portal
5000
Total Students
92%
Overall CSAT
81%
Overall NPS
Office Locations
Development
Centre
Centre
Nazareth
Selvan's Complex, 203,
Margoschis Road, Nazareth,
Tamil Nadu 628617
Margoschis Road, Nazareth,
Tamil Nadu 628617
Development
Centre
Centre
Tirunelveli
Selvan's Complex, 203,
Margoschis Road, Nazareth,
Tamil Nadu 628617
Margoschis Road, Nazareth,
Tamil Nadu 628617
Development
Centre
Centre
Chennai
NO. 07, Kumaran Nagar, 200 Feet Radial Road,
Zamin Pallavaram, Chennai,
Tamil Nadu - 600117
Zamin Pallavaram, Chennai,
Tamil Nadu - 600117
Office Locations
US Office
United States
2093 Philadelphia, Pike,
#5056 Claymont,
DE 19703, United States
#5056 Claymont,
DE 19703, United States
Singapore Office
Singapore
101 Cecil Street,
#20-11 Tong Eng Building,
Singapore 069 533.
#20-11 Tong Eng Building,
Singapore 069 533.
Development
Centre
Centre
Nazareth
13, Agapaikulam 8th Street
Sathankulam Road, Nazareth,Tuticorin,
Tamil Nadu 628617
Sathankulam Road, Nazareth,Tuticorin,
Tamil Nadu 628617
Development
Centre
Centre
Tirunelveli
AP Towers No. A16, NGO 'A' Colony,
North Main Road, Tirunelveli,
Tamil Nadu - 627007
North Main Road, Tirunelveli,
Tamil Nadu - 627007
Development
Centre
Centre
Chennai
NO. 07, Kumaran Nagar, 200 Feet Radial Road,
Zamin Pallavaram, Chennai,
Tamil Nadu - 600117
Zamin Pallavaram, Chennai,
Tamil Nadu - 600117
Singapore Office
Singapore
101 Cecil Street,
#20-11 Tong Eng Building,
Singapore 069 533.
#20-11 Tong Eng Building,
Singapore 069 533.
Development
Centre
Centre
Nazareth
Selvan's Complex, 203,
Margoschis Road, Nazareth,
Tamil Nadu 628617
Margoschis Road, Nazareth,
Tamil Nadu 628617
Development
Centre
Centre
Tirunelveli
AP Towers No. A16, NGO 'A' Colony,
North Main Road, Tirunelveli,
Tamil Nadu - 627007
North Main Road, Tirunelveli,
Tamil Nadu - 627007
Development
Centre
Centre
Chennai
NO. 07, Kumaran Nagar, 200 Feet Radial Road,
Zamin Pallavaram, Chennai,
Tamil Nadu - 600117
Zamin Pallavaram, Chennai,
Tamil Nadu - 600117
Icanio Technologies aims to be the solution to any of your tech problems and a stepping stone to your digital transformation. Talk to us to find out how we have helped our clients become successful and we are sure you will also want to work with us.
United States : (+1) 302 480 9804
India : (+91) 63791 67118