Monday 17 December 2012

More than just a tick box?

There seems to be suddenly a great amount of discussion amongst doctors about e-portfolios and how they can be used in training and in capturing the impact of professional development. This is in part because all GPs are now required to create an electronic record of their competence, indeed I understand that regrettably this requirement is being viewed as so onerous that a number of GP’s have brought forward their retirement plans!


The debate raises some interesting questions about the educational value of what is characterised as the e-portfolio approach. It is of course the case that the judgements being made are in relation to the two e-portfolios that are predominantly being used. One is the e-portfolio developed by NHS Scotland, which is being used by a number of other health professions and the other is one was specifically developed for GPs.

The questions being asked are relevant not only to e-portfolio systems themselves also to the competency assessment systems in which they operate.

• Is this just a tick box exercise in which no qualitative judgements are made?

• How is high quality feedback encouraged and enabled?

• To what extent does the portfolio encourage real development and progression?

• Is it good enough just to be competent?

• Can a holistic approach to professional development and practice be encouraged by easily linking together related learning and practice?

• Does it pass the ‘three click’ rule and is it accessible from mobile devices?

All these are issues that have been raised by users of the existing systems and I do not know the e-portfolios well enough, to make a judgement on the validity of the comments that have been made. What I do know is that we have addressed some of these questions in solutions we have developed.

Our sites positively encourage progression for example radiographers can become recognised as consultant and advanced practitioners based on the quality of evidence they supply; there are effective ways for feedback to be requested and then seamlessly attached to the relevant evidence that is created; all sites pass the three click rule and are accessible from all mobile devices and related evidence can easily be linked together.

What I also know is that effective competency assessment cannot be delivered solely by an e-portfolio. It has to be part of a culture of effective and meaningful professional development. One of the big advantages of an e-portfolio is that it makes it easier to make judgements about the quality of the assessments that are taking place because there is greater transparency. In other words it is possible, for those with permissions to do so, to check that it is more than a tick box exercise.

Saturday 10 November 2012

Learning is the Best Insurance Policy

I recently spoke at the Irish Institute of Radiography and Radiation Therapy’s annual conference when their new online CPD and membership system was launched. Before demonstrating the site I shared a few observations with the conference about CPD.


I first congratulated the IIRRT on embracing an output based approach to CPD. This was wholly in line with the trend amongst professional bodies. Whilst this is most pronounced amongst other health professional bodies other professions are following suit. Simply put what matters more than the time you spend on CPD is its impact, for example, on patient care. At this conference whilst the certificate of attendance is important, what arguably matters more is what delegates discovered at the conference that they could put into practice.

There is a clear change in the role of professional bodies. It is not only about protecting members when problems occur, although that remains important, it is also about proactively encouraging members, to commit to continuous development so they have the skills required to maintain high quality professional practice.

In other words ongoing learning is the best insurance policy.

In this context CPD should be seen as less an encumbrance and more as an opportunity to demonstrate commitment to development. In making that statement at the conference there was already evidence that I was ‘preaching to the converted’. A visit I made on the previous day to the ‘Breast check’ study day in Dublin confirmed that Radiographers and Radiation Therapists were indeed fully engaged in CPD.

I listened to a number of examples of high quality CPD practice. One radiographer/radiation therapist talked about attending a course; bringing the learning back to the workplace and discussing with the peers which led to a positive change in practice, that was evidenced by the research presented at the study day. There were clearly lots of other examples of this process also being presented at the annual conference.

It is perhaps time that we recognise how much quality CPD is taking place rather than listen too much to those that choose to discourage it, often hiding behind the excuse that their employers have not provided them with the time to ‘do CPD’, as if CPD were somehow divorced from practice.

What is critical is that the best practice is captured, valued, acknowledged and shared. Electronic portfolios provide a great way for doing this.

Wednesday 31 October 2012

E-portfolios; Reaching the Tipping Point?

I was at a Sixth Form College recently presenting our e-portfolio for NVQ assessment and was greeted by the college’s Head of Technical Support, who delighted in telling me that e-portfolios were meant to be the big technological advance of the last decade and this has never materialised. I first asked him whether it was worth my while continuing with the demonstration and then asked him what he meant by an e-portfolio and suggested that the technology that underpinned them, may have advanced over the last decade.


I might also have said that in part I shared his delight to see the ‘old concept’ of what was considered to be an e-portfolio being sufficiently challenged, that it was reaching the tipping point where it was significantly under threat.

This challenge is coming from two sources. One is from the ‘So What’ camp which I have highlighted before. If an e-portfolio is just a collection of artefacts that capture someone’s personal development, with the user being in total control of the data, a) what use it is and b) aren’t there better tools that do this like Facebook and Linked In.

The other source is relatively new but arguably even more significant. Various public bodies, notably JISC have promoted e-portfolios that are developed on open source software. This is fine if these portfolios do not contain confidential data. However if they are being used to support the assessment of competence, where that assessment potentially involves confidential information, there are growing concerns about whether these portfolios are sufficiently secure to hold this sort of data. This challenge cannot be a surprise given the origin of the software.

Our approach is that the correct position of e-portfolios needs to be somewhere in between the ‘two camps’. We believe that it is important that the learner’s feels in control of their data and we take great steps to deliver this, however to be able to support effective assessment there does need to be the ability for assessors to interact with that data in a transparent way. Similarly we also think there are great benefits to be gained from sharing technological developments between our customers, but this has to take place in an environment where the software is secure not open.

As for the demonstration it went ahead and the College is now using the e-portfolio although I remain unconvinced that the lessons from one Department’s hopefully successful implementation will be shared across the College.

Wednesday 29 August 2012

Setting the Gold Standard

This year the debate about the GCSE results has extended beyond the day of the results. Usually the morning of celebrations is followed by the afternoon debate as to whether real standards have dropped. The debate then ends and it is business as usual. However the events of last week open up a debate about functional literacy that reaches far beyond the impact on individual schools.


This is not to minimise the impact on individual schools and their students. I have personally witnessed this however the significance of the events this week goes well beyond schools.

In the world of adult learning the focus for many years has been on the number of adults who are not functionally literate and numerate and this has been extended into whether we have the skilled workforce required for the 21st century. There are numerous reports that have addressed these issues.

All these reports assume that there is a standard that could be used to measure functionally literacy and numeracy and a minimum skill level. In respect of skills in Adult Learning world the standard that has been adopted is NVQ Level 2 and it is assumed that you have achieved the standard required to become a skilled worker, albeit with further training, if you have an NVQ Level 2 or you have 5 GCSEs A*-C. If you have not reached this standard then there is lots of funding available you to do so, once you have reached this standard then that funding tends to disappear.

Now I have long argued that adopting this approach is like comparing apples and pears. It is just about a reasonable argument that to demonstrate skills at NVQ Level 2 you do need a significant amount of knowledge, but it is not the ‘type of knowledge’ that is measured by a GCSE.

What however this current debate about the English GCSE exposes is that it is no longer possible to use the ‘exam system’ to determine whether someone has reached the level, which determines whether they are functionally literate. If the decision was made to increase the marked required to achieve a level C by 10 points, as appears to be the case, then that decision appears to be based on maintaining the ‘rigour’ of the exam system rather than on providing a gold standard for literacy.

We wait to see what Ofqual decides to do over the coming week. It will be interesting to see whether they factor into that decision these wider implications.

If they do not then when the next person gets up to say that x millions of adults in this country are functionally illiterate and lack ‘basic skills’, then someone should ask what do they actually mean and how do they know.



Thursday 9 August 2012

Is the e-portfolio movement running out of steam?

It was announced recently that the national e-portfolio in Australia had been cancelled and replaced by a ‘connecting and sharing’ forum. Is this a sign that ePortfolios in Australia is losing momentum?


I attended the national event in Australia a couple of years ago and came away from it with a suspicion that the e-portfolio movement in Australia is being ‘bogged down, with the same issues that affect the discussions about e-portfolios in Europe. There was still too much talk about what is an e-portfolio rather than what they can actually do. The discussion was also dominated by academics without any real attempt to engage the commercial sector.

The announcement about the new Forum in Sydney in September is also accompanied about details of two events. The first event examines ‘ePortfolios as Personal Learning Spaces’. There should be a question mark at the end because there is little evidence that anyone wants to use e-Portfolios as a personal learning space primarily because, in my view; they don’t see the point. This sort of solution has been offered across many Higher Education institutions in the UK but there is little evidence of widespread use.

The second event is about the ‘Using eportfolios for online & Recognition of Prior Learning (RPL) assessment’ I am unsure what will be presented but they perhaps should have a look at the Recognise project recogniseme.ncl-coll.ac.uk/ which is already using an e-portfolio for RPL and it works.

I would suggest that the key questions that this forum in September needs to address, based on the lessons learnt from the wider e-portfolio community are;

• Why is the role of e-portfolio in relation to digital identity even being considered when there are far better and more ubiquitous applications that do this like Facebook etc?

• Is the e-portfolio community really being responsible in supporting ‘Do-it-yourself’ e-portfolio solutions when there are already e-portfolios solutions developed that work? I understand that there are clever people who can build a car from a kit but is that a sustainable model for the future production of cars!

The forum also needs to think about what is the point of re-inventing the wheel continually when there are already solutions that are developed that could effectively work in Australia. I am mindful there is a concern that many of these are developed by ‘commercial companies’ and therefore a dependency on these companies could develop. However by opting for internally developed solutions, all that is happening is that dependency on a company is being swopped with a dependency on a group of individuals in an IT department.

Why the development of e-portfolio needs to continue to be pursued is that is tantamount to the ‘bleeding obvious,’ that technology should be able to bring real benefits to assessment and specifically the assessment of vocational skills. The current paper based systems are indefensible in how they divert people from real teaching and learning to bureaucratic activities; their cost and their impact on the environment. However the e-portfolio community should start taking a more responsible approach to moving this whole debate forward or else it will run out of steam.

Wednesday 18 July 2012

What to make of the 'new' Ofsted

The education press is awash with stories about the new Ofsted regime. These include claims, that for FE College, 61% of inspections have received a lower grade than the one previously awarded and stories that some institutions are taking legal action, with respect to the actions of the inspection team.



I can only speak from my experience and I have recently been in contact with two of the centres who use our e-portfolio, one fully and the other partially, who have both been awarded outstanding grades in virtually all aspects of their provision. This means that two of the three training providers in the South West, awarded outstanding grades, both use our e-portfolio.


It would be easy to say, especially in this blog, that it is the e-portfolio that makes the difference but that would seriously distort the truth. What would be true is their use of the e-portfolio, demonstrates their openness to embrace innovation particularly through the application of technology.


However what really makes the difference is the quality and commitment that runs throughout both organisation and their level of ambition. One of them Didac took the bold step of purchasing their own training centre two years ago and investing in high quality equipment, for a relatively small skill area. At the heart of Didac though is not a building but a leadership team that really cares for their staff and students. As one of their team said recently it is rare to have a boss, who when he has not seen you for a few days, texts you and wishes you well for the weekend.


The other organisation is Reflections Training academy that rather than resting on their laurels following a good Ofsted, pushed ahead with embracing technology; improving their facilities and driving up achievement rates.


In terms of the Ofsted process both organisations speak of very rigorous and intense experiences with lots of contact with students and observations of delivery. You get the sense that the inspectors really got to know the organisation which I imagine is virtually impossible with a large college. The best the inspectors there can do there is to hope that their examination of the performance figures, highlight an issue that they can follow and that this leads them to practice, that is indicative of the organisation. It is a tall order.


I am in no position to comment on the validity of the inspections that are being contested, other than to say that in the ongoing debate about Ofsted we do not lose sight of the organisations that fully deserve their grades good and bad.


Monday 16 July 2012

Qualifications Free(d) for All

There has always appeared to be a hidden ‘scandal’ about the way that qualifications are developed and then marketed in the UK. Registration and examination fees have grown incrementally each year, to the point where some High schools are spending the same amount on exam entries than they do on the salaries of five teaching staff.



This would be just about legitimate if the money from the fees, was ploughed back into the education system, however the truth is that there are cases where the money has disappeared directly into the pockets of individuals.


There was a point where this looked like it was all getting sorted out. The previous government had introduced the Qualification Credit Framework. Underpinning this approach was the notion that units of learning were to be shared and therefore the ability of awarding bodies to ‘own’ and market qualifications was starting to be eroded. However one of the first actions was to remove the quango responsible for the implementing the QCF and declare that the business of developing and designing qualifications should again directly be the responsibility of awarding bodies.


So cue for big celebrations amongst all the large awarding bodies because they can again sit back and watch their profits again start to steeply rise. However there are dangers to the market economy and there is news that there are new players starting to enter it, who are beginning to challenge some of the ‘big players’. Losing the ability to award qualifications for a small sector like for example furniture skills, may not fundamentally shake their foundations but like a small hole in the dam it has the potential to have a significant impact, not least in demonstrating that all Goliaths have their David.

Monday 9 July 2012

Hunt for the missing JISC funded e-portfolio initiative.

Ever heard of LIPID; PortisHEead; ePISTLE; FILE-PASS; ELP; Flouish; Reflect 2.0; PDP4XL2; PC3; SRC; Co-genT; EPPSME; SAMSON; TELSTAR; FASTTECH; MABLE; and PIOP Phase 2 and 3?


Perhaps more importantly do you know where any of them that are currently been used and have had a significant impact on the use of e-portfolios to support the delivery of HE and FE programmes? By significant impact I mean being used across an institution or even a whole faculty or department?

The common feature of all these projects is that according to JISC, all these projects use Pebble pad as their e-portfolio and the subject of investigation or development. In some cases the investigation is wide ranging such as examining the use of e-portfolios by SMEs. In other cases the focus is very narrow e.g. LIPID is about exploring how to take data from the student management system used by Wolverhampton University and make it available via a web service to the Pebble Pad e-portfolio system.

Just for information Pebble Pad was developed by Wolverhampton University but became owned and marketed by a commercial company called Pebble Learning.

I am sure the majority of the money that JISC awarded all these projects went directly to the HE and FE institutions involved and not to a commercial company and I am sure all the money was used and accounted for properly, however it seems right for JISC consider, as is the case with all educational institutions whether they pass the value for money test?

I welcome the fact that all this money has been invested in e-portfolios but to return to the theme of the last blog ‘So What?’ The real question for JISC, amongst others to answer, is have the projects they have been funding been seeking to answer the right questions?

The E-Assessment or the So What question?

This week sees the 10th anniversary of the international ePortfolio & Identity Conference and welcome and the second ePortfolio World Summit. It should be a time for celebration however if you read reports like the one below on the LEAP 2A specification for e-portfolio data exchange http://www.jisc.ac.uk/media/documents/programmes/elearning/Leap2AReviewReport_Final_1.3.p then you would have to conclude that the e-portfolio movement is in real danger of losing its way if it has not done so already. The report is littered with examples of interesting initiatives but the authors find it difficult to come to any conclusions because of the lack of users.



It is worth asking why this is the case when intuitively the development of e-portfolios is an idea that makes such apparent sense. There are potentially huge savings in people’s time and in resources however that is if you consider that the primary purpose of e-portfolios is to support assessment.


The reality will be that at this 10th conference there will be little attention given to this subject and instead there will be the normal focus on e-portfolios and their role, as providing people with their digital identity and then the inter-operability and ownership questions that flow from this.


I have always been baffled by why interoperability is such a big issue for the e-portfolio community. It does not appear to be such an issue for the Apple and Microsofts of this world, who particularly in the case of Apple delight in ‘forcing’ software developers to create applications that work on their devices only.


Is interoperability really such a fundamental issue when individuals are happy to put their content in different places, provided that it can be easily exported to other places and where appropriate links can be made to enable their data, so that it flows between different systems using API links.


With respect of ownership, is it so critically important that the owner is always in total control of their data, particularly when it is being used as part of an assessment. Surely one of the big benefits that e-portfolios bring to assessment is the way that they make the whole process more transparent, to those that have the rights to view evidence because of their role in the assessment process.


So it is not surprising that if all e-portfolios are about is creating digital identities, then users are saying So What and not using them. From our perspective if you do create e-portfolios that have a real purpose, often in the context of assessment and where that e-portfolio is supported by an admin tool that enables you to control who does what and when, then they are used.