AI Employment Tool Developers: Remember the ADA

This is the last blog in the series on the EEOC’s Technical Guidance: The Americans with Disabilities Act and the Use of Software, Algorithms, and Artificial Intelligence to Assess Job Applicants and Employees.  The Guidance ends with the reminder that employers utilizing these Automated Employment Decision-Making Tools (AEDT) can violate the Americans with Disabilities Act (ADA) if the tools (1) pose Disability-Related Inquiries, or (2) conduct a Medical Examination.

The EEOC suggested that the liability flowing from the use of these tools rests with the employers who utilize such tools- not the developers.  This makes sense, as the ADA applies to “covered entities,” and a developer of a tool is not a covered entity under the statute.  With that being said, prudent developers will design these tools with the ADA in mind.  While liability may rest with the employer, no vendor wants its name included in a complaint on the public docket.

General ADA Prohibition

The ADA is clear:

A covered entity shall not require a medical examination and shall not make inquiries of an employee as to whether such employee is an individual with a disability or as to the nature or severity of the disability, unless such examination or inquiry is shown to be job-related and consistent with business necessity.

Prohibition Applies to Employers and Labor Organizations

As discussed above, the statute prohibits covered entities from conducting such inquiries and examinations.  A covered entity is an employer, employment agency, labor organization or a joint labor-management committee.  Notice that the definition does not include developer of employment tool. 

NOTE: The ADA covers employee examinations and inquiries before and after hire. This blog focuses on the inquiries before the individual is hired.

Prohibited Disability Related Inquiries

“Disability-Related Inquiry” is not defined in the statute or regulations. The 2000 Enforcement Guidance on Disability-Related Inquiries and Medical Examinations of Employees under the ADA and the 1995 Enforcement Guidance: Preemployment Disability-Related Questions and Medical Examinations provide the definition. A “Disability-Related Inquiry” is a question or a series of questions that is likely to elicit information about a disability. (NOTE: We discussed the definition of a Disability here.) The following are examples of questions that the EEOC considers violative inquiries:

  • Have you ever had a disability?

  • Do you have a disability?

  • How did you become disabled?

  • What is the nature of the disability?

  • What is the severity of the disability?

  • Provide medical documentation regarding the disability.

  • Asking a co-worker, family member, doctor of another person about the disability.

  • What is your genetic information?

  • Have you ever applied for or received workers’ compensation?

  • Are you currently taking any prescription drugs or medications?

  • Have you taken any prescription drugs or medication in the past?

The above list are examples of violative questions. Just like employers must train their HR employees in the ADA, the AEDT vendors must be well versed in the ADA.

Acceptable Pre-Employment Inquiries

The ADA allows for employers to conduct pre-employment inquiries that relate to the applicant’s ability to perform job-related functions.  Employers may ask candidates to describe or demonstrate how with or without reasonable accommodations the applicant would be able to perform the job-related functions.  In order to conduct a lawful pre-employment inquiry, the employer must have up-to-date and detailed job descriptions that identify the essential functions of the job.

The most effective AEDT’s will be tailored to a specific job opening using such job descriptions.  Employers must work with their AEDT developers for each job position.  AEDT developers cannot use the same pre-employment inquiry for each position, as the essential functions may vary.  

Medical Examinations

“Medical Examination” is not defined in the ADA or the regs. The 2000 EEOC Enforcement Guidance and the 1995 Guidance also guide this definition. A Medical Examination is a procedure or test that seeks information about an individual’s physical or mental impairments or health. When determining whether an examination is medical, the following factors are considered:

  • Whether the test is administered by a health care professional;

  • Whether the test is interpreted by a health care professional;

  • Whether the test is designed to reveal an impairment of physical or mental health;

  • Whether the test measures an employee’s performance of a task or measures their physiological response to performing the task;

  • Whether the test is given in a medical setting;

  • Whether medical equipment is used.

Developers and employers should consult with counsel when evaluating whether the AEDT constitutes a Medical Examination. For instance, many employers use personality tests. The EEOC found that tests designed to measure traits like honesty, preferences and habits are not Medical Examinations under the ADA. With that being said, the Medical Examination definition is a balancing test. Prudent employers will consult with counsel on this topic.

Last Thoughts

Artificial Intelligence is a powerful tool and one that with human oversight can facilitate diversity and efficiency. We are here to counsel developers and employers alike on the employment discrimination implications of the AI.

Susie Cirilli