2013年12月23日 星期一

念博士不如去就業(周祝瑛)/各種排名與論文KPI/​頂級期刊的迷思(李中志)

​頂級期刊的迷思

作者:李中志(美國伊利諾州立大學電腦科學教授)

今 年的諾貝爾醫學獎由美國與德國三位知名生物學家共同獲得,其中一位是來自美國加州柏克萊大學的蘭迪‧謝克曼(Randy Schekman)教授。謝克曼早在20年前就當選為美國國家科學院的院士,歷年在頂尖期刊發表的重要論文多不勝數。然而就在上上周諾貝爾獎頒獎典禮的前 一天,謝克曼在英國衛報發表了一篇令人意外的短文,宣稱以後他的實驗室再也不向頂尖的期刊發表論文,還直接點名《自然》、《細胞》與《科學》這三本生命科 學界最頂尖的期刊。

謝克曼認為這些頂尖期刊為了衝高其「影響指數」(impact factor),以非科學的目的引導研究方向,猶如限量發行的名牌皮包,刻意製造一個不健康的競爭環境,嚴重扭曲科學研究的動機與客觀性,讓這些頂尖期刊 不再是最佳科學成果的保證。其實這是離一般大眾相當遠的議題,但這篇短文一發表立刻被瘋狂傳閱,不數日便有上萬人引用,顯然已在英美的學界激起共鳴。

計算點數扭曲研究

頂著諾貝爾桂冠的光芒,謝克曼講出了許多研究者敢怒不敢言的心聲,但由上述期刊的主編回應來看,似乎對謝克曼的抵制不置可否,並不在意。這些期刊的態度之所以如此傲慢,來自供需失衡,對這些頂尖期刊而言,諾貝爾獎得主不算稀客。

隨 著研究總量的暴增,學界為了方便行事,用各式各樣的指數來量化研究成果的優劣,再以計點制來評鑑研究者。但若只知機械式計算點數,研究工作將被扭曲為病態 的競爭。結果就是讓許多好的研究者,尤其是剛進學院的年輕教授,為了生存只好去追逐熱門題目、漸進式發表研究成果、共同掛名、在熱門問題上對小枝小節敲敲 打打,這種策略性的研究,對一個初入門的不知名研究者而言,是比創新一個新的研究方向更容易擠進頂尖期刊的。等而下之的,更有製造假數據,買賣論文的怪異 現象。

評鑑觀念恐該調整

其實對「影響指數」或名牌期刊的迷信,這幾年已普遍在美國的學界引起反思,謝克曼不是第一 個,也不會是最後一個。許多系所已逐漸捨棄以期刊的計點做為評鑑教授研究的唯一標準,我們認為,做為一個經過學院完整訓練的評鑑者,應該具備能力根據內容 來判斷一個學術論文的好壞,而不必機械式的計算它在哪裡發表的點數。台灣學院的評鑑觀念,似乎也到了要調整的時候了。




「話說十幾年前大學很窮,希望教育部多給錢,遂央請幾位德高望重的士林大老向教育部建言,提出5年500億(頂尖大學)計畫。立法院要求設立量化目 標,以免浪擲納稅人的錢,於是教育部提出世界大學排名的目標以及論文數的指標。要衝高論文數就必須增加博士生名額,而博士生是從碩士生來的,所以各大學紛 紛增加碩博士生名額,果然,10年來臺灣各大學的論文產出迅速成長,也因此在各種世界大學排名不斷往前邁進。」

這種生態,吳誠文稱之為學術界代工文化,「各種排名與論文KPI就像產品規格一樣,客戶一下單,規格有了,學術代工產業就迅速完成任務,不必煩惱市場的開拓。」

教授的KPI主要是論文數,「而論文產出又極度仰賴作為研究主力的博士班學生,所以博士班學生如果不見了,教授就沒戲唱。」於是乎,碩博士生英文再菜,程度再差,天龍國頂尖大學都必須錄取,畢竟,台灣的大學排名和學術代工生意就靠他們了。

 

焦點評論:念博士不如去就業(周祝瑛)


 國內各大學博士班的招生缺額逐年增加,因此,台大今年(2013) 改採1年2次招生的策略,但10月首度舉辦博士班甄試入學的結果,仍出現6成5缺額。為此,嚴長壽先生提出嚴重質疑,認為台灣不需要這麼多博士,台大不應因招不滿博士班缺額而帶頭重招!
從十多年前,國內在教育部政策鬆綁與選舉民粹的推波助瀾下,忽略了少子女化時代的來臨,而廣設高中、大學,結果各大學廣招碩、博士,雖然讓國內各行各業人員普遍學歷大幅提升,但高教擴張卻帶來許多後遺症,不但衝擊整體技職教育體系與就業市場,也造成許多大學教師即將面臨因少子化招生困難而被迫離職的窘況。尤其嚴重的是博士班畢業生因大學教職僧多粥少,企業需求短絀,已經很難找到工作。筆者特此呼籲:面對國內高教嚴冬,建議有意報考博士班者三思! 

大學招生面臨缺額

首先,台灣高教中的「2015大限」已無法避免,屆時整體大學新生將出現近三分之一嚴重缺額 (一年約減少五萬五千人),大約到了2021年開始,博士班招生缺額更困難。如果主管單位與各大學相關機構對於整體高教 (尤其是博士班) 的結構不及早重整,並尋找因應策略,屆時博士班招生大海嘯,後果將嚴重影響整體高教的發展!
其次,從近年來台灣高教擴張的過程中,根據蔡宏政、陳東升、陳也禎等教授的研究,過去十年來國內博士研究生人數大約增加 2.44 倍;但各大學專任教師數目僅增加 1.24 倍,且博士生的增長速度更快。加上國外大學博士畢業生返國求職,整體博士就業市場已經飽和甚至過量,未來很長一段時間的博士畢業生,恐將面臨更加嚴峻的就業市場挑戰!
第三,近年來各大學國科會、頂尖大學計劃、世界大學排名、大學評鑑等政策推動中,各大學徵才條件比以往更加嚴苛,不分領域專業,不但要看畢業是否來自名校,還要看在有無國科會研究計劃、有無SSCI 、SCI等論文發表、外語程度與社會網絡關係如何等等條件。有些要求早已遠超過上一代學術工作應徵者的門檻,甚至其中充滿了不合理的工作要求條件 (如只能以契約型條件一年一聘等)。 

博士生須身兼數職

第四,在上述大學評鑑壓力下,大學教授的首務不再是教學,而是忙於國際期刊論文的發表(如:SSCI)。許多實驗室與各項計劃需才孔急,徵人協助與合作發表。
因而,博士生必須身兼數職,不但需要協助教師的教學,甚至研究與發表都不能免,每月領取的微薄助理薪資,只夠餬口。
第五,許多大學對於博士生又訂定各種論文發表點數畢業門檻,讓整體博士養成教育淪為論文發表點數競技場,讓年輕的博士世代,不論在找指導教授或發表論文等方面,為了能順利畢業與日後就業發展,必須步步為營、斤斤計較。
由此可見,國內學術界過去所標榜的「教自由、學自由」與「為學術而學術」的氛圍已經不再!年輕人與其困守在學術象牙塔,不如及早出去尋職或創業,奮力一搏,以免整個人生都因為讀博士而受到耽誤與影響! 
政大教育系教授、教改論壇執行祕書 

2013年12月19日 星期四

Paul Buckland who stood up against dumbing down of degrees

The university professor who stood up against dumbing down of degrees

Paul Buckland refused to pass students who didn't understand the basics of archaeology - and he's just one of many academics under pressure to raise the marks of undeserving students. So will Buckland's legal victory halt the destruction of standards in some universities, asks Julie Henry

Paul Buckland
Paul Buckland at his home in Sheffield Photo: RII SCHROER
When Professor Paul Buckland settled down in his garden one summer's evening to mark exam papers from his second-year archaeology students, he was expecting the usual range of responses. But it soon became clear that the scripts had plummeted to new depths of ignorance.
In one paper, the decline of elm trees was attributed to diseases passed on by dogs. Next, a student explained that the volcanic eruption in Pompeii had "changed the pattern of human evolution". By the time he read that farming caused smaller jaws in humans, his head was practically in his hands.
The professor failed 18 out of the 60 papers he marked. And that was where his problems began.
For three years, the academic has been embroiled in a conflict with Bournemouth University over its decision to overule his professional judgment on the standard of his students' work and increase their scores.
The battle has effectively ruined his career. At the lowest point, Professor Buckland was even forced to ask his 89-year-old father for financial help.
But last week, a decision by the Court of Appeal hopefully marked the end of his ordeal. To the academic's immense relief, the court upheld his contention that the south-coast university raised the grades of weak students without his knowledge, and that his resignation, when it refused to reinstate his marks, amounted to constructive dismissal.

But the 62-year-old's nightmare has also cast light on a more widespread issue that vice-chancellors steadfastly refuse to acknowledge. According to Professor Buckland, a battle for standards is raging within parts of the UK higher education sector.

On one side are academics anxious to maintain quality and control over the courses they teach. On the other are managers, generally in newer institutions, who regard students as pots of cash and care more about recruitment and drop-out rates than ensuring that students' marks reflect the work they do.

"The implications go way beyond Bournemouth," said Professor Buckland. "Before last week's ruling, the message sent out to universities was that you could bully staff into upping grades – 'if you don't give the marks we want, we'll get someone else to do it for us' – which is what happened to me."

The saga began in 2006 when his department decided to remark the papers the professor had failed – 14 after students had resat – even though a second marker endorsed his scores, as did the external examiner. On the basis of this fourth assessment, scores were increased by up to six percentage points, moving several students from a clear fail to a pass.

These were students, the professor said, who after two years of an archaeology degree did not know if the mesolithic age came before or after the neolithic.
"The papers were farmed out to someone who didn't have the necessary expertise and it was all done behind my back," said Professor Buckland, who lives in Sheffield with his wife, Joan.

"It makes a mockery of the entire system if the relevant expert in the field is not allowed to return the marks. We get students who have to work damned hard to get their degree. Then there are students who just drift through, spend most of their times in bars, being given the same degree. It's an insult to the people who have worked hard."
Over the last few years, as the effects of the relentless expansion of student numbers in the 1980s and 1990s have been felt, evidence has been emerging of "dumbing down" in some institutions.

The cases reveal staff under pressure to bump up results and ignore rampant plagiarism by students. If the pass rate is too low, lecturers are questioned by university examination boards, regardless of a student's attendance or the amount of work they put in. Any academic who sticks his head above the parapet to complain faces the wrath of university authorities.

Walter Cairns, a law lecturer at Manchester Metropolitan University, was kicked off the institution's academic board last year when he revealed in a submission to MPs on the universities select committee that 20 marks were added to the scores of around 90 students studying international business law in 2005 because their results were so bad.
Sue Evans, an economics lecturer at the same institution, told the committee that marks were frequently revised upwards without justification.

At De Montfort University, in Leicester, internal documents revealed that the university had "upgraded" a number of first- and second-year pharmacy students – effectively lowering the pass mark on one course to 26 per cent – after half of them failed their exams.

Staff who taught and marked the papers said that some students were simply "not up to the rigours of the programme" and, in many cases, "had a poor attitude to work".

Similar concerns have been raised by lecturers at Hertfordshire, Teesside and Central Lancashire Universities. Students are turning up on campuses less well prepared than ever before. Even those with passable A-levels are struggling to cope with the essay writing, book reading and independent work required at degree level.

Many academics blame the education students receive at secondary school. The argument is familiar – exams are getting easier and a narrower curriculum is failing to teach content which is crucial to further study.

Last week Sir Mark Walport, the director of the Wellcome Trust, added weight to the argument. His government-commissioned report found that multiple choice, short answers and modular exams were damaging the study of maths and science.
The knock-on effect is that academics in some institutions are under increasing pressure to give undergraduates higher grades than they deserve. A recent poll of 500 dons found that 77 per cent felt coerced in to awarding inflated marks. Two thirds felt that the increase in first-class and upper-second degrees was not a sign of improving standards, and more than half said that reports that universities were dumbing down "were not overstated".
Professor Buckland, the first in his family, with his sister, to go to university and a staunch supporter of higher education expansion, agrees: "We have a ridiculous system where quality is gauged by the number of firsts you award. When I taught geography in Birmingham in the 1980s we went for three years without awarding a first. There was no complaint. A good 2:1 was recognised for the high-level qualification it was. Birmingham recruited top-class students but in those particular years, they were not quite the level of a first.
"If we did that now, there would be a public inquiry. In the past a 2:2 was a credible degree, now it's seen as almost the equivalent of a fail. That is an appalling situation. British degrees are no longer valued in the way they were on the continent."
A damning select committee report published last summer said the system for checking university standards was "out of date, inconsistent and should be replaced". It also accused vice-chancellors of "defensive complacency" over the system and said that whistleblowers, like Professor Buckland, needed more protection.
MPs recommended that the Quality Assurance Agency (QAA), which checks that university procedures protect quality, be abolished or transformed to give it powers to police teaching and degree standards. Not everyone agreed with them, including Peter Williams, former head of the agency. He said that a "Spanish inquisition" of the university sector, one of the most successful in the world, was unwarranted.
More importantly, an Ofsted-style university inspectorate would be expensive. In an era of swingeing cuts to higher-education funding, pouring cash into this quango is not on the agenda.
On Friday, Bournemouth University decided not to appeal against the Court of Appeal ruling. In a statement, it said that the case was a matter of employment law and not a matter of academic standards.
"There is not and has not been an issue over quality and standards at Bournemouth University," said a spokesman. "The 2008 QAA audit said academic standards were sound."
For Professor Buckland, the decision, which will mean substantial compensation, could not come too soon. "It has been difficult for my family, my wife," he said. "We've been living on savings and the small amount of consultancy work I've got. I'm driving around in my father's car.
"The system really does work on fear. If you had a young family to support, you wouldn't be able to afford to put yourself in the firing line."