INFORMATION AND PROGRESS An analysis of what is happening in the Caribbean with information, decision-making and progress in Education

At a meeting… During the last policy dialogue 17/18-2-05 the members talked about ways to measure progress… Several important questions were presented.

The questions were: How to evaluate the impact of policy interventions? What are the best mechanisms and indicators to evaluate progress? How to evaluate particular policies and programs? How to make sharp application of results in policies and programs? How to collect and report data effectively? How to best evaluate student achievement? How to make evaluation results readily available for decision-making?

Finding Answers… First, let us take a look at what is happening in the Region now with information, decision-making and accountability… Then, we should think at what are the necessary elements to make it work in the way we would like them to work…

To know the present… A questionnaire was developed and send to a sample of seven countries. The person filling the questionnaires were contacted for an interview. We got six full answers.

The Answers… In general, all the countries in the Region have developed a certain kind of information system. They all also have complains that they share. Some of the weaknesses of these systems are the same. There is also the fact that the level of development of the systems is different depending on which country is analyzed.

Generalities… All the countries produce statistics of the educational system. Information as coverage; drop-out rates; repetition rates; and similar statistics. The numbers are available for each individual school. As a tradition in the Caribbean countries there is a system of examinations that offer an approximation to the quality of the learning that takes place in the schools…

More generalities… A certain level of financial information is always available… The most common model is that this type of data comes from outside MOE… Usually the Ministry of Finance. The performance of the teachers is always a concern. Nevertheless not all the countries have a measurement system in place. In many there is the tendency to develop one.

But there are problems and limitations… The statistical information produced is not always reliable. It takes a lot of time and effort to obtain it since it is mostly done by hand. It is not always timely produced and not always available.

The analysis of data… The system does not always have the experience analyst to give all the possible insights. The data is in many occasions of demographical nature permitting limited analysis.

In summary… To a very large extent decision is done on sufficient and reliable information, well analyzed and shared. The exercise however is generally very time consuming and late in submission given: The data has to be collated and organized since it emanates from different sources… Obtaining the data takes longer than is desirable… The analysis has to be done by personnel that has other tasks… There are no computer networking systems…

Looking for a solution: some points to have in mind The real sense of the so called “political will”. The real possibility of putting together all the resources needed to develop a real MIS. The development of a powerful shared vision. The ability to put in place good and realistic action plans.

“POLITICAL WILL” Sometimes this ingredient is mistaken by the idea of the “will to win”. Not so… It cannot be considered a personal phenomenon. It is more a combination of factors. It is social.

The elements of “political will” It is not only to want to do something… It is more to be in a position to do what is needed and willed. The issue must be recognized as a priority. The real possibility needs to be there. The political situation needs to be conducive to such an initiative.

The question of resources An important issue to consider before starting any MIS initiative is the level of resources available for it… Financial Human: Technical and analytical Infrastructure

But not only information… To have information is important, necessary… but… There are more important elements. It is necessary to know where the system should go… To have a vision, a comprehensive vision of what has been defined as desirable.

Where do you want to go? How can you know if you have arrive? If you are getting closer? The first element is a clear definition of where you want to go…

Think about Alice… When you are faced with a crossroad… Which road will take to your destination? It depends on what your destination is… If you do not know… then all roads are the same. The element of a vision is necessary… and most likely it should be shared.

But is not enough… OK… Maybe you have defined where you want to go… You developed the vision… You have discover your direction… The option has been made… But… That is simply not enough. The next step is to develop the strategy to get there and to identify the different stepsthat need to be taken…

The road forward… The vision of the future: The desired situation clearly defined. Indicators: To know if you are really getting closer. The road that need to be traveled: strategy, action plans… The here and now: A good baseline study defining what is the situation.

You need… A framework based on a vision of the future in order to define the road that needs to be traveled… That will help to identify the information that is significant. It will provide the background in which the significance of information and actions can be properly understood.

You need indicators… They must have the three elements: Q-Q-T (Quantity-Quality-Time) They must be related to what has been presented as future vision… They must show if the goals have been achieved… Or if the process is on-going they must show progress or the lack of it… They should be understood by all stakeholders… Because they are the support of real accountability.

The What-How-When-Who It is based on a good understanding of what needs to be done… A good plan that will define the how, who and when to do it. Knowing that the information required become easier to identify. The indicators can be designed to respond to what needs to be known and measured.

Two models of MIS… Centralized It is self-contained in the MOE. It produces information faster. It is easier to coordinate. It has impact mostly in Education. It could lead to duplications. Descentralized It covers most or all the components of the Government. It is more comprehensive. It serves the government as a whole. It requires much more coordination. It has broader impact.

What is better? Difficult to say in general. Each model has its own advantages… and its own problems… It needs to be appropriate to the needs of the country and its possibilities,

What to do? Consider it a priority… Not the MIS (this is only a tool) but what is thought to be needed. Formulate a vision of the future. Define a strategy. Look for the appropriate means. Select outcomes indicators. Gather the baseline data. Set specific targets and a timeline. Establish the information system. Regularly collect data. Analyze and reort results.