Revealed: The dangers of HR using AI

A new study has revealed how deeply ingrained stereotypes can be perpetuated by AI, impacting recruitment, pay equity, and career aspirations.

Prompts for CEO’s, doctors, engineers, carpenters, electricians, manufacturing workers, and salespeople produced exclusively male results. Meanwhile, images of women were entirely generated when inputting the job titles of housekeeper, HR manager, marketing assistant, receptionist, and nurse. The only job that AI programmes repeatedly generated both men and women for was a teacher. However, when asked to produce content about a headteacher, the outputs reverted to including men only.

The study* found that it’s not just harmful gender stereotypes AI is conforming to. In the same study, race and age were clearly considered when generating both images and text. When CEOs were generated, they were exclusively white, middle-aged men, whereas young white women were generated under the job title of marketing assistant. Looking at deskless industries, manufacturing workers were generated solely as young men of colour, and housekeepers were all young women, some mixed race.

Chris Brown, CEO  at Rippl says, “AI can be a great tool when it is set up correctly and teams are trained in its proper use. However, we also know AI is susceptible to bias, and this study demonstrates just how widespread this problem is when it comes to workplace stereotypes.

“The impact these enduring biases can have in the workplace is huge. If AI is used to screen CV’s or identify potential candidates, its bias can lead to qualified individuals, particularly women and minorities, being overlooked. This can perpetuate existing pay inequities, where women and minorities are often paid less for the same work. Studies have also shown that stereotyping is still having an impact on children’s career aspirations.

“While AI undeniably has its use in the workplace in supporting and streamlining working processes, this experiment is a stark reminder of its limitations. Its inherent bias and lack of regulation means it simply cannot be a replacement for humans – and people practices must remain human-led to ensure all talent is accurately represented, seen and heard, and celebrated for their contribution.”

*Rippl

    Read more

    Latest News

    Read More

    Spring into employee recognition: Simple ways to show appreciation

    28 February 2025

    Newsletter

    Receive the latest HR news and strategic content

    Please note, as per the GDPR Legislation, we need to ensure you are ‘Opted In’ to receive updates from ‘theHRDIRECTOR’. We will NEVER sell, rent, share or give away your data to third parties. We only use it to send information about our products and updates within the HR space To see our Privacy Policy – click here

    Latest HR Jobs

    HRUCSalary: £36,964 to £39,023 per annum, including London Weighting

    London School of Economics and Political Science – Human Resources Division (HR)Salary: £42,429 to £50,656 pa inclusive (pay award pending) inclusive of London allowance

    ODI Global – Human ResourcesSalary: £71,020 / year

    Are you a trusted CHRO/HRD/CPO with the insight to shape executive decisions? Have you lead a multi-disciplined HR function and continued to drive success? Can

    Read the latest digital issue of theHRDIRECTOR for FREE

    Read the latest digital issue of theHRDIRECTOR for FREE