Legal professionals worldwide should be aware of a recent case in which technology company iTutorGroup, Inc. had to settle for $365,000 with the Equal Employment Opportunity Commission (EEOC). The federal agency alleged that the company’s artificial intelligence (AI) software explicitly discriminated against certain applicants based on their age. Notably, it was claimed that the software automatically rejected female tutor applicants over 55 and male tutor applicants over 60. This case raises significant questions about fairness in AI algorithms and the potential implications of such technology on employment practices.
This information was first shared by Bloomberg Law and further delved into the implications of AI in employment on the wider legal system. The use of AI in employment decisions is becoming increasingly common, with companies adopting these technologies in an effort to streamline processes. However, this case highlights critical issues around how these technologies can inadvertently introduce discrimination into the process.
As reported by JDSupra, specific details about how the iTutorGroup’s AI operated remain sparse, but the case’s outcome suggests that the software was making decisions based on protected characteristics. In this case, the protected characteristic is age, resulting in discriminatory practice.
This case raises pertinent questions around how companies can ensure that their employment practices, particularly when involving AI, remain unbiased and legally compliant. This is especially significant given the rapid development and adoption of AI solutions in a variety of industries and processes, including hiring. How regulators and entities address these issues moving forward will be crucial in defining how companies can responsibly adopt such technologies.
Beyond the immediate legal implications of this case, it also presents a cautionary tale for companies considering the implementation of AI into their operations, particularly in areas handling sensitive data such as recruitment. Regular and rigorous testing and monitoring of AI systems may be necessary to prevent outcomes such as these, stressing the urgency to develop effective auditing techniques for AI implementations in business operations.