{"id":413,"date":"2015-07-01T13:20:42","date_gmt":"2015-07-01T13:20:42","guid":{"rendered":"https:\/\/ltidevcloud.languagetesting.com\/blog\/?p=413"},"modified":"2018-06-05T13:23:06","modified_gmt":"2018-06-05T13:23:06","slug":"the-dos-donts-of-evaluating-language-competency-when-hiring","status":"publish","type":"post","link":"https:\/\/ltidevcloud.languagetesting.com\/blog\/2015\/07\/01\/the-dos-donts-of-evaluating-language-competency-when-hiring\/","title":{"rendered":"The Do’s & Dont’s of Evaluating Language Competency When Hiring"},"content":{"rendered":"
\n
\n

\"\"Many 21st<\/sup>\u00a0century jobs require individuals who have specific skill sets or competencies which can be proven with certifications, ratings, or official measurements. Rarely would it be enough to trust a job candidate to evaluate his or her own abilities as a computer programmer who claims to be proficient in a specific programming language. Nor would it be acceptable to have a current employee ask a few questions to find out if a candidate can handle a complicated, technical, and demanding job.<\/p>\n

Likewise, when determining whether or not someone has the foreign language proficiency specifically required for a position, there are certain Do\u2019s and Don\u2019ts that can help guide the process for hiring managers and human resources professionals.
\n
\nDON\u2019T: Rely on Candidate Self Report<\/strong><\/p>\n

\u201cFluent in Spanish\u201d . . . \u201cConversant in Arabic\u201d. . . \u201cWorking knowledge of Mandarin Chinese\u201d. . . These phrases are often included on r\u00e9sum\u00e9s with no explanation or proof of actual proficiency. Some companies learn the hard way that assuming someone has a certain level of language can have negative repercussions when that person is asked to perform tasks beyond their abilities.<\/p>\n

Josebe Bilbao-Henry is Program Manager for the Language and Culture Program at The World Bank, the unit that combines both client learning and staff learning, with a particular focus on staff learning of business skills. She stresses the importance of accurate language measurement, rather than having individuals give their own evaluations.<\/p>\n

\u201cSelf-rating is not very reliable,\u201d says Bilbao-Henry, who has worked with language education and testing in corporate programs and law firms in Washington, D.C., and other professional settings. \u201cI\u2019ve seen very well-educated adults doing self-rating in languages and it tends to be all over the place. You might have people who are advanced speakers who claim they still have a lot of trouble with the subjunctive, and would rate themselves lower even if they have a high level of functional skill.\u201d Then again, she says, \u201cthere are people who are fairly confident and good communicators who rate themselves very highly because they get messages across\u2014but this doesn\u2019t really correspond to certain level of accuracy.\u201d<\/p>\n

She continues, \u201cIf someone writes on their r\u00e9sum\u00e9: Spanish, fluent, I would say approach at your own risk. Rely on that information at your own risk. It doesn\u2019t necessarily mean much. If someone tells you, \u2018I have working skills in Spanish\u2019\u2014I would ask, working where? In a kitchen? In the streets? Or conducting negotiations? Because there are different work environments that require different skill levels.\u201d<\/p>\n

According to Bashar Haddad, chief operating officer at Mid Atlantic Professionals\/SSI, a company that provides foreign language instructors, cultural advisors, subject matter experts, role players, linguists, interpreters, and translators, mainly to U.S. government agencies: \u201cApplicants will give you their opinion as to what their language score is . . . I can tell you 50% of the time the scores are right on the money and 50% of the time the candidates will tell us they have this particular level but when they are actually tested, they aren\u2019t as good as they think they are.\u201d<\/p>\n

DO: Recognize the Consequences of Miscommunication<\/strong><\/p>\n

\u201cDepending on what the role of the employee is\u2014if he is involved in negotiations, any type of interpretation, or escorting a visiting businessperson or dignitary and he is the one who is doing the informal conversation\u2014misunderstandings occur. You can only imagine what can happen as a result,\u201d says Karen Decker, president of the International Center for Language Studies (ICLS) in Washington, DC. \u201cIf it\u2019s a question of someone doing translation or correspondence, there are so many different things that can go wrong if a person is not at the level she claims she is and the level the company itself needs and expects her to have.\u201d<\/p>\n

Marketing missteps, ineffective localization, culturally insensitive messages . . . all are problems that can occur when the person responsible doesn\u2019t know what he or she doesn\u2019t know. Plus, \u201ca lot of the work is done at the cocktail party after the meeting,\u201d says Decker. So, cultural nuances, behavior in different environments, body language, and even how to present a business card can have everything to do with success using a second language in business.<\/p>\n

DON\u2019T: Assume That Native Speakers Are Necessarily Qualified<\/strong><\/p>\n

When an organization needs to fill a position that needs someone with specific language skills, often they think that hiring a \u201cnative\u201d or \u201cheritage\u201d speaker is the answer. But, what does that even mean? Heritage speakers, who often have grown up in a dual language environment, may have some conversational skills but could still lack the necessary proficiency in business communication.<\/p>\n

\u201cTheir language might be only at a certain in-the-house-with-family level,\u201d Decker notes. \u201cPeople don\u2019t really understand what proficiency means and what you can do at different levels of a language. They get hung up on the idea of a \u2018native speaker\u2019\u2014that terminology. Then the assumption is that you are at the highest level just because you are a native speaker.\u201d<\/p>\n

One hiring manager in a large Silicon Valley technology firm shares about the pitfalls of relying on the heritage-speaker criteria. \u201cWe have hired people who claimed they had the language skills we needed to accompany their tech skills,\u201d she says. \u201cBut they really couldn\u2019t hold their own communicating in higher-level international interactions. It was disappointing.\u201d<\/p>\n

DO: Learn About Accurate Language Tests<\/strong><\/p>\n

Validated and certified language proficiency testing can offer an accurate measurement of language level (with a corresponding label such as \u201cIntermediate Low\u201d or \u201cNovice High\u201d) that directly explains to what an individual can actually\u00a0do<\/em>\u00a0in the language.<\/p>\n

There are several scales of measurement that are common and recognized as accurate for determining proficiency, including the American Council on the Teaching of Foreign Languages (ACTFL) scale and the Inter-Agency Language Roundtable (ILR) scale.<\/p>\n

\u201cHaving a measurement and understanding of what proficiency really means can help a company decide whether that\u2019s attainable,\u201d says Decker. \u201cSo, for example, if you really expect someone to conduct a meeting in a language, most businesses do not have the time or the resources to invest to get an employee to that level . . . Maybe a company when they truly understand what the levels mean will think it\u2019s okay that this person is at an Intermediate-Low level, that will be enough for THIS job but not so much for another job. Because it\u2019s not about how many pages in the book you covered; it\u2019s a lot more than that.\u201d<\/p>\n

Decker is familiar with language testing in her position at ICLS, an independent language school offering both English as a second language and foreign language training to professionals.<\/p>\n

\u201cCompanies are always looking for ways to measure what people can really do with language,\u201d she says. \u201cWe get calls all the time to do this, but we are not an official testing organization; we are a school. Individuals will sometimes call and say, \u2018I\u2019m looking for a job,\u2019 or \u2018I\u2019m working with a government contractor,\u2019 and they may have the need for a person to be at a specific level in the language. So they\u2019re going for a government contract and they have to say they can speak language at this level or this level. How do they measure that? They need to take some kind of proficiency test.\u201d<\/p>\n

\u201cThe fact that there is a standardized way to conduct an interview, that there is a set of standards for the levels, really allows you to see whether the needle is moving,\u201d says Bilbao-Henry.<\/p>\n

DO: Research the Convenience of Online Testing<\/strong><\/p>\n

Many organizations use an Oral Proficiency Interview (OPI) to get an external measurement of an individual\u2019s ability to speak the language at different levels. The OPI is a live, 20-30 minute conversation over the phone between an ACTFL certified tester and an applicant. The Oral Proficiency Interview by computer (OPIc) is an Internet-delivered test which provides valid and reliable oral proficiency testing on a large scale, offered by Language Testing International (LTI). The computer-delivered assessment emulates the \u201clive\u201d OPI, but delivery of questions is through a computer program, and via a desktop avatar. Thus the test can be taken on demand, and at a time convenient to the candidate and proctor.<\/p>\n

Decker states, \u201cWe have 10 levels of instruction in English and we say that students can do certain things according to ACTFL or ILR level. We say they are at a certain point on that scale based on our expectations and our curriculum is developed to meet those goals. But how do we know they\u2019ve really met those goals? We\u2019ve been using LTI to help us measure speaking, listening, and reading. We\u2019re using the computer-based test for our students so that when they leave they can actually have a piece of paper that says this is what I can do in English and this is how it\u2019s been measured, not just by my teacher or the school. So we\u2019re assuming they can take that professionally and say this is my level of English.\u201d<\/p>\n

Haddad\u2019s company also uses the OPIc because, he says, an ACTFL language proficiency rating for each person is required by their largest client, United States Special Operations Command (USSOCOM). \u201cThis particular client has the most stringent requirements,\u201d he notes.<\/p>\n

DON\u2019T: Put Unqualified Employees in a Bad Position<\/strong><\/p>\n

Sometimes a company will try to take a shortcut by asking another employee who speaks a language fluently to evaluate a candidate who claims to have skills in the language. But this can backfire, as the responsibility for evaluation now rests with someone who has not been trained to evaluate language levels. This can open the organization, and the employee, up to unanticipated risks.<\/p>\n

\u201cThere are certain elicitation techniques that testers use when you are having an OPI,\u201d says Decker. \u201cIt sounds like a normal friendly conversation but actually it\u2019s a fishing expedition and the tester is eliciting certain tasks that a speaker can do and then pushing them to where their ceiling is in terms of speaking. A lot of times the testee may not realize what the tester is doing. It takes a lot of skill and understanding of what the proficiency levels are.\u201d<\/p>\n

That skill and understanding is highly valued by those employers who appreciate the importance of accurate language measurement. And it should be carefully considered by those who may not fully realize just how crucial it is.<\/p>\n

– By Sandy Cutshall<\/p>\n<\/div>\n<\/div>\n","protected":false},"excerpt":{"rendered":"

Many 21st\u00a0century jobs require individuals who have specific skill sets or competencies which can be proven with certifications, ratings, or official measurements. Rarely would it be enough to trust a job candidate to evaluate his or her own abilities as a computer programmer who claims to be proficient in a specific programming language. Nor would […]<\/p>\n","protected":false},"author":16,"featured_media":0,"comment_status":"closed","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"_acf_changed":false,"footnotes":""},"categories":[2,3],"tags":[16,130,97,92,62,7,129],"class_list":["post-413","post","type-post","status-publish","format-standard","hentry","category-commercial","category-government","tag-actfl","tag-employment-jobs","tag-hiring","tag-hr","tag-human-resources","tag-language-testing","tag-speaking-test"],"acf":[],"aioseo_notices":[],"jetpack_featured_media_url":"","_links":{"self":[{"href":"https:\/\/ltidevcloud.languagetesting.com\/blog\/wp-json\/wp\/v2\/posts\/413","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/ltidevcloud.languagetesting.com\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/ltidevcloud.languagetesting.com\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/ltidevcloud.languagetesting.com\/blog\/wp-json\/wp\/v2\/users\/16"}],"replies":[{"embeddable":true,"href":"https:\/\/ltidevcloud.languagetesting.com\/blog\/wp-json\/wp\/v2\/comments?post=413"}],"version-history":[{"count":2,"href":"https:\/\/ltidevcloud.languagetesting.com\/blog\/wp-json\/wp\/v2\/posts\/413\/revisions"}],"predecessor-version":[{"id":416,"href":"https:\/\/ltidevcloud.languagetesting.com\/blog\/wp-json\/wp\/v2\/posts\/413\/revisions\/416"}],"wp:attachment":[{"href":"https:\/\/ltidevcloud.languagetesting.com\/blog\/wp-json\/wp\/v2\/media?parent=413"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/ltidevcloud.languagetesting.com\/blog\/wp-json\/wp\/v2\/categories?post=413"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/ltidevcloud.languagetesting.com\/blog\/wp-json\/wp\/v2\/tags?post=413"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}