Category: Electoral IQ

  • Something’s wrong – I find myself agreeing (in general) with a PD

    http://www.progressivedemocrats.ie/press_room/1812/

    Senator Minihan makes a good deal of sense in his speech to the Seanad (Irish Senate, second house of our executive).

    His is the closest I have seen in the debates and coverage thus far to an apolitical statement of purpose. Also, he has touched on a number of potential root causes for the current state of the register.

    He is espousing a long term strategy (good) and a short term scrap and rework (not so good, but necessary at this stage). He questions why there is so much variation in ‘quality’ between local authority areas and what the motivation might be for local authorities to manage the register in the current modus operandi.

    Significantly he states that the long term planning shouldn’t be put off until after the election but should start now. This is in keeping with good Information Quality Management practice where scrap and rework is commenced in parallel with process review  and improvement (ideally process improvement should start first).

    My recommendation is that the root cause analysis that is currently at anecdotal level should be formalised into a format similar to that outlined in my Draft Paper on Electoral Register Information Quality Approaches. The root causes should then be prioritised in terms of their frequency of occurence and their ease of remediation.

    Senator Minihan correctly points out that you need to provide more information when setting up an ESB account or a phone account than you do when registering to vote. Is that not a telling root cause?

    However, the challenge now is to ensure that the constancy of purpose that Senator Minihan calls for is achieved as if the governemnt believes that some scrap and rework is all there is to solving this problem they are sorely mistaken.

    I’ll have to read this speech a bit closer to find exactly what it is I can disagree with.

  • Excel – some noteworthy c*ckups…

    The nice people over at the European Spreadsheet Risks Interest Group have an excellent website with good examples of spreadsheets gone wrong.

    Here’s one about sorting errors

    And another… here

    And another… here

    and another… here

    and another … here

    and another… here (this one relates to electoral roll data)

    and another… here

    Some of these links might be broken now as some of the articles are a bit old but the EUSPRIG site has summaries of the stories.

    My finger is sore from cutting and pasting links… if you want to see more on the risks of relying on spreadsheets, check out http://www.eusprig.org/stories.htm

  • Finger print scanning and Indelible Ink in the Electoral Process

    I have been distracted from compiling my post on the use of excel as a data interchange mechanism by some other snippets of what Dick Roche said at yesterday’s Dail committee meeting as reported in the Irish Times (page 9) and Dublin’s freesheet Metro (page 5)…

    1. The Census Enumerators haven’t gone away… €5 million to €6 million is being provided to Local Authorities to hire temporary staff “such as census enumerators” to carry out door to door inquiries. The Unions haven’t gone away either though and I suspect that Local Authority staff currently doing those jobs might be offended by this idea. And at the end of the day it is €6 million between 114 Local Government agencies (29 County Councils, 10 City/Borough Councils and 75 Town Councils) or an average of €52632 per agency to pay temporary staff for the duration of the scrap and rework. (that calculation assumes that Town Councils have a role to play in the Electoral Register – if Town councils can be excluded that amounts to just under €154k per Local Authority). Of course, this is still just scrap and rework – the process of gathering the information will use the same apparently broken processes to capture the new register. Once the cleanup is finished, unless there is a study of the root causes, the same defective processes will operate to corrupt the register almost immediately and taxpayers will find themselves having to fund another €6million clean up in the not to distant future.
    2. The Minister has put forward a proposal to avoid voter fraud at the Polling stations in the next election. “Indelible Ink or fingerprint scanners could be used in polling booths at the next poll” (source: Metro). Of the ink, the Minister is quoted as saying “it woudl be a badge of pride that you had participated in democracy”. Allllllrrrrrriiiiiigggggghhhhhtttttyyyyy then.

    My first recommendation is to ban CSI and its spin off shows from the Roche household. Capturing a fingerprint at the time of a ballot would be totally useless unless there was a master data source of citizen biometric data that could be referenced – even Gil Grissom has to have a finger print in the database before he can nab the criminal.

    This is a proposal that I would suggest Digitial Rights Ireland jump all over quick smart as, in my view, this combined with the call to use PPS numbers brings us one step from a ‘big brother’ single view of citizen with biometric data. And as the Government seems to be incapable of properly managing complex technology projects I would be very concerned by this.

    I’ll get my post on Excel done over the coming days – unfortunately pesky day job is getting in the way. ;(

  • Electoral Register on Oireachtas Report

    The coverage of the Dail Committee meeting on Oireachtas Report this evening was a little disappointing. They only covered the Minister’s speechifying on the topic and didn’t show if there had been any debate or challenge on the topic from any of the Opposition politicians who sit on the Committee such as Labour’s Eamon Gilmore.

    My feeling is that anyone who has been following my posts on this site and is familiar at any level with the scrap & rework concept would have found a few open goals in what Dick Roche was putting forward.

    1. Use of ‘relevant databases’ within Local Authorities – this amounts to a process change to address a root cause (well done Minister). However there may be data protection issues given that data can only be used for the purposes for which it is captured – this fact was glossed over by the Minister. In addition, just because one has a second surrogate source for reality it doesn’t mean that it is any more accurate or complete than your ‘problem’ dataset. Furthermore, what tools do Local Authorities have available to them to actually match across these datasets quickly and accurately (short of manual efforts)? The Minister has been somewhat quiet on the ‘how’.
    2. The Minister referred to using ESB databases to update the register on the basis that we all use the ‘leccy. Again, this is not a complete surrogate for reality as it would hold the details of only one, at most two, individuals at an address. That data may not match against the Electoral Register for a variety of reasons (different spelling of names, use of aliases or akas (e.g. John Vivian Smith may be listed on the ESB bill as J.Vivian Smith or just plain old Vivian Smith or just J Smith)) – Again Data Protection issues (and commercial considerations) exist here but were glossed over by the Minister.
    3. Finally, Minister Roche is plowing ahead with the plan to give records of deceased persons to Local Authorities. The data will be sent in Excel format. There are issues with that idea that I will address in a later post (once I have gotten my thoughts on it ironed out) but in the meantime the question that arises is simply this – once the Local Authorities have their Excel spreadsheets of names and addresses of the deceased, how will they go about matching them against the Electoral Register and flagging matches for action? What is the process that will operate to convert raw data into actionable information?

    This issue is a national crisis. The Government seems content to operate on a scrap and rework basis with no real thought leadership or strategy. It is all well and good to identify potential sources of data against which the accuracy of the register can be checked, but in the absence of clear processes to use that information or the capability to process it all that Local Authorities will have is more data and a Minister who’s approach has been to criticise and berate and to effectively manage by sound-bite. Provision of ‘ring fenced’ budget and 3rd party data sets will not enable Local Authorities to perform their duties re the Electoral Register any better if there is no understanding of what needs to be done to address these problems in the long term.

    Where is the action plan to assess root causes and address the core deficiencies in the Electoral Register process? Where is the leadership in terms of thinking and in terms of control of the processes?

    I wonder what the boys and girls over at Digital Rights Ireland would have to say about the ESB providing its billing database or customer relationship management database to EVERY Local Authority (in excel format perhaps)?

    My suggestion of 2 weeks ago still stands…

    1. Scrap the current register
    2. Mail everyone on the current register and request that they re-register
    3. Use that register as the appropriate data set for the Draft Register
    4. In parallel assess Root Causes – involve Local Authority staff (not County Managers but Revenue Collectors, Librarians – anyone with a role in the process) to identify the root causes – even go as far as to talk to (dare I say it) Citizens to find out what is broken in the processes
    5. Develop a plan to address those root causes, addressing governance issues and Information Architecture issues as well as cultural issues.

    Scrap and Rework without corresponding review and improvement of processes will not solve the problems in the Register, it will merely postpone them until a later date.

  • Dail Committee Discussion on Electoral Register issues

    There is a Dail Committee discussion on the Electoral Register issue being held this afternoon at 16:15. The Minister for the Environment will be facing questioning on what is being done to fix our shambles of an electoral register.

    According to the published schedule, this discussion is to be televised. I’m not sure exactly where on the Oirechtas.ie website the Dail committee discussion will be televised, but the link to the general page is here.

    Oireachtas Report is on RTE1 at 23:40 tonight so it might carry coverage there.

     

  • Electoral Information Quality – A Consolidating post

    As the blog is getting legs a bit now, I thought it best to consolidate the posts of the last few weeks on the Electoral Register issues into one point of reference, particularly for readers new to the site.

    I am also taken the opportunity to upload a few additional articles etc. that I have written on the issue to the blog for reference.

    Articles:

    First up is a draft paper I have put together on the proposed solutions and why they are likely to be inadequate. 

    Next up is a link to an article I have had published in an International newsletter for Information Quality Management Professionals.

    Finally there is an article based on my post on what scrap and rework is of earlier this month. This article was submitted to national newspapers as an opinion piece – and I should acknowledge the assistance of Simon over on Tuppenceworth with whipping it into shape. Click here to download Scrap and Rework article. The article is also reproduced as an appendix in the previously mentioned report.

    As regards posts – pretty much any of the posts in the Information Quality/Electoral Data Quality category are relevant. I will double check all the post categorisations to make sure that nothing is missing.

    That’s my update for today.

     

     

  • The Irish Times Editorial yesterday…

    The Irish Times ran a nice editorial piece yesterday (2006/05/11) on the Electoral Register that highlighted the administrative failure that surrounds the Electoral Register.

    One good line: “IF the potential for abouse exists within the voting system – and it unequivocally does – the Government’s responsibility is to protect democracy and correct the electoral register

    The Old Lady of D’Olier Street correctly identifies that there is a “reluctance at official and political level to step outside traditional mechanisms to address the situation”.

    The reported ruling out by Dick Roche of the use of personal identification at polling stations reflects this apparent lack of willing to change processes to improve the quality of the register and improve the controls on the Electoral process. As the Irish Times rightly points out, you have to produce evidence of address to get a parking permit from Local Authorities. I can’t join a library in Dublin because I don’t have a utility bill at an address in Dublin.

    The chronic lack of leadership on this issue is appalling. Here’s a link to a piece I’ve written in an International Journal for Information Quality people… it references some reseach that was done in 2004 into attitudes to Information Quality in UK Public Sector organisations…

    … in the mean time as the Irish Times haven’t responded to the opinion piece I sent them based on my chocolate cake/scrap & rework post I suppose I’ll have to tout it around the other papers… I’ll stick up the draft for reference here later today.

  • Link to my comments on tuppenceworth..

    Those nice punters concerned citizens over at Tuppenceworth have taken up cudgels in defence of democracy and quoted from my post explaining scrap and rework to explain to their readers why they should prepare for a feeling of dé ja et ré ja vú… (french for “I’ve been here before, and I’ll be here again”).

    Here’s the link to them and here’s a trackback link to my comment to them re: ICT Expo…

    I was disappointed… but given the number of Healthcare, Dept of Social Welfare and HSE people who came along I would be less worried about going to hospital and claiming for the sick days off the social than I would be about whether my vote would actually be counted in the midst of “vote-spamming” (a term I will now coin to describe the use of fictitous votes or the ‘stacking’ of the register to influence the outcome of an election)…

     

  • Reponse to Damien Blakes’ post on irishelection.com

    Damien Blake written a good piece on IrishElection.com regarding his view on how to address the Electoral Register.

    Much of what he says has merit as a short term solution. He suggests that we scrap the register (no problem there) and rework it from scratch (again, no problem there) rather than limp on with a defective register.

    Damien suggests that my writings will eventually find their way into undergraduate or post graduate theses.  I too look forward to the day that clear thinking about the fundamental best practices of Quality Management applied to Information form part of University curricula at undergraduate level and post-graduate level, much like the practices of Manufacturing Quality Management gained acceptance. In the US this is already beginning to happen, and I have been involved in curriculum development work with an Irish University in a similar vein.

    What I have written is based on a number of years (best part of a decade) working in complex Information Management environments and on the shared experiences of other practitioners in the Information Quality Management space with whom I have spoken at conferences (internationally), and with whom I work on a regular basis as a Director of the International Association for Information & Data Quality. The techniques, methodologies and approaches I put forward are based on my real world,practical experiences in applying best practices that have been proven in other industries and disciplines.

    Damien’s further goes on to suggest using the PPS Number and associated data to register people – preferably automatically. What Damien has suggested here is a process change to address root causes of poor data quality. Excellent. That is what I have been writing on… well at least as far at the review/change of processes goes. I’ll come ot my concerns with his proposal in a moment. Well done for thinking about the root causes of the problem and how the processes can be changed to address it. Top of the class that man.

    Damien’s suggestion doesn’t address the fact that there is no legal obligation on anyone to register to vote, and it could even be argued that one has a constitutional right not to register to vote. Automatic voter registration based on a “Single View of Voter” may not be a runner. Also, the Data Protection Commissioner has limited the uses that a PPS number can be put to – however I am sure legislation could get around that. The Digital Rights Ireland site has a nice paper on it about the ‘scope creep’ in the use of PPS Numbers that I’ve referenced in an earlier post.

    Ultimately, even if we scrapped the Register in the morning and rebuilt it in a shining pristine form, the simple fact is that name and address data degrades at a significant rate. In the absence of clear controls and processes to manage and maintain that data at an acceptable level of quality we will find ourselves rapidly returning to a situation where the Register is unreliable – Scrap and Rework is not the route to a high quality Information asset. It is a step on the journey, and an important process – but in the absence of process re-engineering to address root causes of defects and deficiencies the inevitable result is more scrap and rework.

    Damien’s proposal to use the name/address/citzenship data associated with the PPS number would serve to reduce redundancy of data (multiple copies of the same data held in multiple data stores) but it may run into Data Protection issues. But as a change of process for the management of Electoral Register data to address deficiencies in the existing process it has merit. But should you have to be a tax payer or a recipeint of State benefits in order to vote?

    Damien’s suggestion for a Statutory agency or a reallocation of resources/roles to task someone with maintaining the Register. Again, I am in wholehearted agreement. What Damien proposes here is a review of the Governance model for this data to give clear accountability, authority and mandate and (I would surmise) a standardisation of processes, controls and toolsets for managing and measuring the quality of Electoral Register data. I fully agree with the general thrust of Damien’s proposal here, although the specifics of what that Governance model in my view should be aligned with the requirements of the process and the requirements of the controls necessary to ensure the quality of the electoral register – simply assigning a role with a stroke of a pen does not deliver quality improvements.

    I agree with Damien that the process for voter registration and for maintaining that data should be a simple as possible. Clear definition of processes and business rules to support ‘flow-through’ registration and data maintenance are part of the Information Architecture design that should underpin any long term solution. Simplicity of process  could be part of the ‘customer expectation’ against which the quality of the process (and the information it produces) could be measured. However a simple ‘customer’ interface that sits on top of chaotic processes riddled with deficiencies and absences of controls to ensure the quality of the Information will not achieve the full objective of a simple to operate set of processes or functions that deliver reliable and high-quality Electoral Register information.

    Damien is right. We need to start again. We need to start again in terms of the information in the Register. We need to start again in terms of the Governance model that is put in place to manage this Information Asset. We need to start again in terms of the processes that people follow to create, update and maintain that information to ensure that we achieve our objective of a reliable, accurate (within a margin for error) Electoral Register. We need to start again in terms of how we think about the ‘architecture’ that this Electoral Information is held. We need to start again in terms of ensuring that we adopt appropriate technologies and strategies to address identified weaknesses in the processes for managing our Electoral Register data.

    However, to focus just on scrap and rework simply solves the problem of today. Addressing the root causes in the processes and governance as well as conducting scrap and rework on the data solves today’s problems and prevents those of tomorrow.

    I’m glad Damien and I are in such agreement on the principles, even though we may differ in our view on specifics (specific solutions aren’t my goal here – raising awareness of Best Practices was my intention). I hope he can find the time to attend the Information Quality Master Class that is being held in the RDS on Friday where a person with even more years experience in this domain than I will be sharing his knowledge with delegates