IDEAS home Printed from https://ideas.repec.org/a/dbk/ethaic/v4y2025ip413id413.html
   My bibliography  Save this article

Human-in-the-Loop Models for Ethical AI Grading: Combining AI Speed with Human Ethical Oversight

Author

Listed:
  • Muthu Selvam
  • Rubén González Vallejo

Abstract

The adoption of AI-powered grading systems in academic institutions promised improved efficiency, consistency, and scalability. However, these benefits introduced ethical challenges, including algorithmic bias, contextual insensitivity, and reduced transparency, particularly in high-stakes assessments. To address these concerns, the chapter presented a Human-in-the-Loop (HITL) grading framework that integrated AI-generated recommendations with human oversight. The model consisted of four layers: (i) pre-grading configuration with customizable rubrics and model calibration; (ii) preliminary scoring using transformer-based language models; (iii) human validation and contextual adjustment of AI outputs; and (iv) transparent feedback supported by dual-logged audit trails. A case study was conducted at a mid-sized university, where the framework was applied to 800 undergraduate essays. As a result of this implementation, the faculty validated 87 % of the AI-generated scores with only minor adjustments, while 13 % required overrides due to misinterpretations involving creative expression, linguistic nuance, or cultural context. The grading time was reduced by 40 %, and student satisfaction improved due to transparent assessment and educator involvement. These findings demonstrate that the HITL model has the potential to balance automation with ethical oversight, promoting fairer evaluations and preserving academic integrity. It enhanced faculty agency, ensured equity across diverse student populations, and built trust through explainable AI tools such as SHAP and LIME. The chapter concluded by proposing policy guidelines, technical integrations, and communication strategies, while advocating for future applications in multimodal grading and open-source ethical assessment platforms.

Suggested Citation

Handle: RePEc:dbk:ethaic:v:4:y:2025:i::p:413:id:413
DOI: 10.56294/ai2025413
as

Download full text from publisher

To our knowledge, this item is not available for download. To find whether it is available, there are three options:
1. Check below whether another version of this item is available online.
2. Check on the provider's web page whether it is in fact available.
3. Perform a
for a similarly titled item that would be available.

More about this item

Statistics

Access and download statistics

Corrections

All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:dbk:ethaic:v:4:y:2025:i::p:413:id:413. See general information about how to correct material in RePEc.

If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

We have no bibliographic references for this item. You can help adding them by using this form .

If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Javier Gonzalez-Argote (email available below). General contact details of provider: https://ai.ageditor.ar/ .

Please note that corrections may take a couple of weeks to filter through the various RePEc services.

IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.