From Self-Assessment to External Quality Assurance - Global and [PDF]

Scopul curriculei actuale a USMF ”Nicolae Testemiţanu” este educaţia medicală generală prin promovarea unui set

0 downloads 5 Views 3MB Size

Recommend Stories


Requirements Quality Control, External Quality Assurance and Method Evaluation
Don't fear change. The surprise is the only way to new discoveries. Be playful! Gordana Biernat

Quality Assurance and Quality Control
The butterfly counts not months but moments, and has time enough. Rabindranath Tagore

Quality Assurance and Quality Control
And you? When will you begin that long journey into yourself? Rumi

wima quality assurance assurance
Stop acting so small. You are the universe in ecstatic motion. Rumi

Laboratory Operations and Quality Assurance Manual (PDF)
Life is not meant to be easy, my child; but take courage: it can be delightful. George Bernard Shaw

Quality Assurance
What you seek is seeking you. Rumi

Quality Assurance
The wound is the place where the Light enters you. Rumi

Quality Assurance
No matter how you feel: Get Up, Dress Up, Show Up, and Never Give Up! Anonymous

Quality assurance
Be grateful for whoever comes, because each has been sent as a guide from beyond. Rumi

quality assurance
Kindness, like a boomerang, always returns. Unknown

Idea Transcript


F ROM S ELF -A SSESSMENT TO E XTERNAL Q UALITY A SSURANCE

FROM SELF-ASSESSMENT ASSURANCE

TO

EXTERNAL QUALITY

CONTENT 1.

FROM SELF-ASSESSMENT TO EXTERNAL QUALITY ASSURANCE

3

Links Between Internal and External Quality Assurance

3

Steps Towards External Assessment

5

Preparation for External Accreditation

6

2.

THE ROLE OF STAKEHOLDERS

Society and Labour Market The Role of Students in QA for Higher Education

3.

EX ANTE EVALUATION REPORTS OF STUDY PROGRAMMES IN MOLDOVA

Moldova State University

8 8 10

19 19

Ex Ante Evaluation Presentation (RO)

19

Ex Ante Evaluation Report (RO)

21

Technical University of Moldova

24

Ex Ante Evaluation Presentation (EN)

24

Ex Ante Evaluation Report (EN)

27

Ex Ante Evaluation Report (RO)

30

State University of Medicine and Pharmacy ”Nicolae Testemițanu”

34

Ex Ante Evaluation Presentation (EN)

34

Ex Ante Evaluation Presentation (RO)

37

Ex Ante Evaluation Report (EN)

40

Ex Ante Evaluation Report (RO)

43

From Self-Assessment to External Quality Assurance

Tiraspol State University Ex Ante Evaluation Presentation (EN) Alecu Russo Balti State University

46 46 48

Ex Ante Evaluation Presentation (EN)

48

Ex Ante Evaluation Report (EN)

51

Ex Ante Evaluation Report (RO)

56

Cahul State University “Bogdan Petriceicu Hasdeu”

61

Ex Ante Evaluation Report (EN)

61

Ex Ante Evaluation Report (RO)

65

4. RECOMMENDATIONS FOR SITE VISITS

From Self-Assessment to External Quality Assurance

69

1. FROM SELF-ASSESSMENT TO EXTERNAL QUALITY ASSURANCE Links Between Internal and External Quality Assurance JOSEP GRIFOLL (ENQA & AQU CATALUNYA)

What is IQA? “Developing enhancement and accountability mechanisms for internal purposes and external requirements”

Actors ∙ ∙ ∙ ∙ ∙ ∙

Institutional managers (using current structures / ad hoc committees) → Leadership / policy Quality assurance managers → Knowledge development / methodology / training / dissemination Teachers → Suggestions for improvement / policy implementation Students → Suggestions for improvement / monitoring Administrators → Managing information, suggestions for improvement Stakeholders (external) → Advisory functions

The Self-Assessment Process ∙ ∙ ∙ ∙ ∙ ∙ ∙ ∙

Institutional / programme (organisation / product) Ex-ante or ex-post Improvement oriented / accountability oriented Integrated with other processes (follow up) / singular process Voluntary / compulsory Individual / thematic Distribution of responsibility Position of IQA within the whole process (more or less “important” than EQA?)

STEPS ∙ Responsibility and leadership ∙ Dissemination of the process (within the institution) ∙ Methodology (analysis of protocols, understanding, selection of evidences…) ∙ Data collection and preparation of evidences ∙ Preparation of a self-assessment document (rapporteurs) ∙ Presentation of the main conclusions of the selfassessment (internally) ∙ Adjustment of the content according the views from the academic community ∙ Final version of the self-assessment document and dissemination (publication) ∙ Selection of the audiences who will be interviewed (according the methodology)

Outputs Self-assessment document: ∙ According an ex-ante template? ∙ Scope and framework of the evaluation (identification of the process (year)) ∙ Self-assessment team (composition of the team and reasons for that composition) ∙ Central part: Description of the reality / assessment (strong and weak points) / conclusions (recommendations) ∙ Data (quantitative) ∙ Evidences (are they public?) ∙ Final statement SWOT analysis (where we go?) Is the self-assessment document one of the main tools for improvement? Transparency policy (publication of the self-assessment document?)

Trends Investing in Quality Assurance for Higher Education, how? (IQA and EQA balance, maturity in the mechanisms) Promoting expertise in quality assurance (managers/stakeholders)

From Self-Assessment to External Quality Assurance

3

Cost-effectiveness (impact of internal quality assurance?) Quality Assurance policy at national level? (equity / identification of excellence?) How does this produce changes in the IQA mechanisms? Risk based approach? (IQA promoting trust and being recognised as part of the quality of an institution?)

What is EQA? “independent review teams assess the quality of a HE institution for enhancement and accountability purposes”. In the European model the EQA is linked to the IQA by reports.

Actors ∙ ∙ ∙ ∙ ∙ ∙

Quality assurance agency National academic community Students Society (professionals, employers) International stakeholders Government

Steps in External Evaluations ∙ ∙ ∙ ∙ ∙ ∙ ∙ ∙ ∙

The methodology for EQA is public and known by all actors at the beginning of the process. Appointment of reviewers Training of reviewers Schedule of the external assessment visit Preparation of the visit Implementation of a visit Drafting the review report Presentation to the assessed unit Elaboration of the review report and presentation to all interested parts

Outputs ∙ Self-evaluation report (should be confirmed by the EQA) ∙ Review report (is a complement of the SAR? Or it contains a full perspective?) Formal decision (accreditation) Commendations / Recommendations ∙ Follow-up (evaluation of improvements) ∙ Other outputs (reputation) ∙ Levels of transparency (should be decided at the beginning of the whole process IQA +EQA)

Trends The role of trust in the process: ∙ Stronger role of IQA and less intensity in EQA? ∙ Looking for the quality of the products (programmes) or the quality of the processes (institutions)? ∙ Other methodologies coexists with QA: supporting innovation in the development (teaching and learning) or quality control on the outputs (achievement of learning outcomes) ∙ Self-regulation mechanisms (use of incentives) ∙ Fulfillment of minimum standards and/or recognition of outstanding areas?

From Self-Assessment to External Quality Assurance

4

Steps Towards External Assessment JOSEP GRIFOLL (ENQA & AQU CATALUNYA)

Objectives of the external assessment ∙ ∙ ∙ ∙ ∙ ∙

Learning process. (IQA staff will participate in the review teams) Involvement of stakeholders in quality assurance activities (students and labour market representatives) Enhancing current practices in Higher Education Institutions Best practices identification for national dissemination Promoting a national network of QA experts Be prepared for international accreditation processes

Implementation of EQA Team Composition MEMBERS’ PROFILE ∙ Chairperson: vice-rector in QA* / IQA manager ∙ Dean ∙ Student (those represented in the project)** ∙ Representative from the labour market (professional or employer) interested in HE (*) All IQA managers should be involved in the process as full members of the review teams. (**) If new students are needed they should be enrolled preferably in a master programme with professional orientation.

TEAM SELECTION AND APPOINTMENT ∙ Each university proposes one chairperson (Vice-rector or IQA manager), a dean and a labour market representative ∙ Students should be selected from the current project group (if additional students are required, they can be proposed by students unions) ∙ As independent reviewers they are not appointed to assess their “own” university, except for labour market representatives (all should be approved the HEI) ∙ The project management group will make a distribution of the panel members to compose the review teams REVIEWERS DISTRIBUTION (EXAMPLE) Chair

Dean

Labour M.

Student

SUM Moldova

TUM

USB

SUM (proposed)

TSU

USB Alecu Russo

TSU

SUMPh

USB (proposed)

TUM

SUC Cahul

SUM

TUM

SUC (proposed)

SUMPh

Technical TUM

SUMPh

SUC

TUM (proposed)

USB

SUMPh Med & Phar

SUC

TSU

SUMPh (proposed)

SUM

Tiraspol TSU

USB

SUM

TSU (proposed)

SUC

Schedule of the site visits (audiences) ∙ ∙ ∙ ∙

IQA manager and vice-rector for QA. (self-assessment) Strategic management representatives (strategy/design) Deans / Heads of Departments (strategy implementation) Students (users)

From Self-Assessment to External Quality Assurance

5

∙ Labour market representatives (users) ∙ Administrators (implementation and monitoring) The site-visit can be carried out in 1 day: Meetings with the audiences during the morning. Conclusions after lunch.

Review report (individual for each HEI) ∙ Presentation of the context ∙ Presentation of the process (panel composition, interviewed representatives…) ∙ Assessment of the quality (analysis) ∙ Assessment of the quality (evidences) ∙ Conclusions ∙ Recommendations for the HE institution ∙ Recommendations for the national HE system

Individual reports are confidential (?) but they will provide the basic information for a systemic analysis that could be public (?)

Networking (first actions for an IQA experts national commission) PREPARATION FOR THE FINAL WORKSHOP IN GIRONA: The IQA representatives should present their experience as external assessors Important! to make recommendations on how to conduct self-assessments Managing evidences within HEI Use of values (transparency, stakeholders participation, promotion of equity / excellence) It is recommended to prepare a final document with: Recommendations for the national system on how to design and approve HE programmes Suggestions for the organisation of external assessments in the Moldovan HE system

Preparation for External Accreditation RONNY HEINTZE, COMMISSIONER FOR INTERNATIONAL AFFAIRS, AQAS

Why Undergo Accreditation? ∙ ∙ ∙ ∙ ∙

Accreditation provides independent external assessment Accreditation involves key stakeholders in the process Accreditation follows standards that are transparent and known to all actors involved Accreditation helps to identify unused potentials for improvement Accreditation certifies that certain standards are fulfilled / that the programme is in accordance with the European Standards and Guidelines (ESG)

AQAS‘ Accreditation Procedure (I) Consultation with HEI HEI prepares accreditation documents (Self Evaluation Report) Feedback on documents by AQAS Opening of accreditation procedure by AQAS accreditation commission Accreditation Commission nominates the panel

From Self-Assessment to External Quality Assurance

6

Panel of Experts Each panel is individually selected to fit the requirements of each accreditation procedure. Experts must be independent. Typical constitution of a panel: ∙ 2 expert(s) from a HEI ∙ 1 expert from the field of professional practice ∙ 1 student member (coming from a pool managed by student organizations) ∙ At least one exert must be familiar with the HEI-system ∙ SER is written for the Panel – they must understand the programme based on the SER

Panel‘s Report All reports follow the same structure (following the European Standards and Guidelines): ∙ Aims of the programme ∙ Curriculum ∙ Organization ∙ Labor market orientation / Employability ∙ Staff and material resources ∙ Quality assurance The panel gives a recommendation of accreditation to the accreditation commission HEI can comment on the report before a decision is taken

AQAS‘ Accreditation Procedure (II) Preliminary statements of panel members

Visit to the HEI

Panel's report

Decision of AQAS accreditation commission

Appeal Procedures

What is the result of the procedure? ∙ ∙ ∙ ∙

Feedback from external actors on the quality of the programme The feedback is standard-oriented The feedback is neutral as the reviewers are independent In case of a positive decision the report confirms that the programme is run in accordance with the ESG

From Self-Assessment to External Quality Assurance

7

2. THE ROLE OF STAKEHOLDERS Society and Labour Market JOSEP GRIFOLL (ENQA & AQU CATALUNYA)

Different assessment procedures The quality of education? What are we teaching? What are students learning? How is education managed? How are study programmes designed? (ex-ante) How well do we know that a certain design is working (or not)? (ex-post)

How do we assess the quality in HE? (in the 90’s)

From Self-Assessment to External Quality Assurance

8

What Kind of Experts?

The Quality of a Study Programme or the Quality of the Graduates?

How to Assess the Quality of Those Two Blocks

From Self-Assessment to External Quality Assurance

9

Why Management of HE is so Interesting Well structured system (easier than looking for quality) with: ∙ Clear thresholds (the programme has consulted the LO with relevant stakeholders)

∙ ∙ ∙ ∙

Use of pre-defined quality schemes Interdisciplinary implementation International use Neutral in terms of stakeholders interests

The Role of Students in QA for Higher Education FERNANDO M. GALÁN, VICE-CHAIRPERSON, EUROPEAN STUDENTS’ UNION

Background The European Students’ Union The European Students' Union (ESU) is an umbrella organisation of 47 National Unions of Students from 39 different countries. Through its members, ESU represents over 20 million students in Europe. The aim of ESU is to represent and promote the educational, social, economic and cultural interests of students at the European level towards all relevant bodies. For ESU it is vital that quality assurance enjoys ownership of all internal and external higher education stakeholders as then we can assure effectiveness. ESU thus works to improve the role of students in quality assurance processes in order to ensure legitimacy and transparency and to promote improvement in teaching and learning.

The beginning …

Nowadays …

From Self-Assessment to External Quality Assurance

10

Bologna Process

Role of students in HE ∙ "World Declaration on Higher Education in the Twenty-first Century: Vision and Action", by the World Conference on Higher Education of UNESCO, recognizes students as one of the main stakeholders in higher education. (1998) ∙ Within the Bologna Process: the Prague Communiqué’01 recognizes that students are full members of the academic community and constructive partners as subjects, active and competent in the establishment and construction of the EHEA. ∙ European approach to Higher Education: role of student not just as users (or even clients), neither as external stakeholders, but as co-responsible members of the university community.

From Self-Assessment to External Quality Assurance

11

Students & the ESG The Berlin Communiqué’03 reminds that by the year 2005 national systems of quality assurance should include, inter alia, participation of students. By the Bergen Communiqué in 2005 the European ministers of education endorse the document "Standards and guidelines for quality assurance in the European Higher Education Area“, drawn up by the E4 Group, that provides a framework for quality assurance systems that includes the participation of students in these systems.

Standards? Guidelines? ‘Standards’ in this context are not meant to imply ‘standardisation’ or ‘requirements’; ‘Standards’ are statements of basic good practice; they are short and general ‘Guidelines’ are meant as illustrations of the standards in action; they provide additional information and explain why the standards are important

ESG part 1: HEI’s internal QA 1.1. 1.2. 1.3. 1.4. 1.5. 1.6. 1.7.

Policy and procedures for quality assurance Approval, monitoring and periodic review of programmes and awards Assessment of students Quality assurance of teaching staff Learning resources and student support Information systems Public information

ESG part 2: External QA 2.1. 2.2. 2.3. 2.4. 2.5. 2.6. 2.7. 2.8.

Use of internal quality assurance procedures Development of external quality assurance processes Criteria for decisions Processes fit for purpose Reporting Follow-up procedures Periodic reviews System-wide analyses

ESG part 3: QA Agencies 3.1. 3.2. 3.3. 3.4. 3.5. 3.6. 3.7. 3.8.

Use of external quality assurance procedures for higher education Official status Activities Resources Mission statement Independence External quality assurance criteria and processes used by the agencies Accountability procedure

Creating a bulding for QA THE EUROPEAN STANDARDS AND GUIDELINES (2005) ∙ The “bible” for believers and practicioners?... ∙ Creating common guidelines for comparability ∙ Establishing common standards for mutual trust ∙ Is there a tension between standards and guidelines? THE UNESCO-OECD GUIDELINES FOR QUALITY PROVISION IN CROSS-BORDER EDUCATION (2005) ∙ ESG for the world? Who enforces them?

From Self-Assessment to External Quality Assurance

12

∙ Quality ensurer or consumer protection? ∙ Bigger share of international students in Europe – do we need to know this document a bit better? E4 GROUP: ENQA-ESU-EUA-EURASHE (2001) ∙ Body taking decisions on QA? Steering the debates? ∙ Setting the agenda? Is there a common agenda? ∙ What is the mission now for this group? THE EUROPEAN QUALITY ASSURANCE FORUM (2006) ∙ Giving room for practicioners to share experiences ∙ Creating a QA sector public opinion? ∙ Monitoring and reacting to developments ∙ A stage for an agenda setting for the 4 organisations EUROPEAN QUALITY ASSURANCE REGISTER (2007/08) ∙ Cooperation model between different partners ∙ Steered by the E4 Group – no longer the governments? ∙ Or by the “independents”? ∙ Allows for mobility and the creation of a common area? ∙ Or a tool for a European market?

From Self-Assessment to External Quality Assurance

13

European Quality Assurance

European perspective Role of students

Changing perceptions ∙ ∙ ∙ ∙

Students have not been considered as a full member of the university community. Students haven’t had got the same representation rights as other members of the community. Student participation was not formally implemented in all universities. Nor consolidated participation nationwide

A real demand? The student participation in Quality Assurance in some countries can be seen not as a real demand from the their students, students’ union, universities or QA agencies; but as a consequence of the Bologna Process implementation in the country. This top-down approach has several implications… From Self-Assessment to External Quality Assurance

14

Consequences of student participation in QA Student participation in QA activities as full members are generally perceived as very positive and really appreciated. ∙ Other team members consider that students play a key role in the whole evaluation process, especially for the relevant aspects to students. ∙ The QA agencies have shown an enrichment of the evaluation reports, expanding and including other aspects not previously taken into account, or complementing those which have not been addressed in the same way. ∙ Universities have welcomed this participation, for them is an opportunity to expand the analysis and therefore to improve their quality.

Identified levels of student participation

How do we know? ESU’ publications ∙ Bologna With Student Eyes (’03*, ‘05, ‘07, ’09 & ’12) ∙ The Black Book of the Bologna Process (‘05) ∙ Bologna At the Finish Line (‘10) ∙ QA Handbook (‘03)

From Self-Assessment to External Quality Assurance

15

BWSE’12

From Self-Assessment to External Quality Assurance

16

What is ESU doing? 1. Creating the QA experts’ pool Selection based on CVs, trainings and evaluation A team of people with real expertise and knowledge The first image of ESU in front of agencies and HEIs Increasing expertise of the sector within ESU Increasing knowledge on QA amongt students 2. Mainstreaming student participation ∙ Contacting national agencies ∙ Identifying practices and models and lobbying ∙ Cooperating with ENQA and the IEP-EUA ∙ Publications & research 3. Creating a ‘student quality’ concept 4. Identify what information students want from HEIs 5. Consult with regards to QA processes to assess the usage of European Standards & Guidelines on QA (input into MAP-ESG project for revision of ESGs) Method: desk research, site visits and surveys, one survey directly to students! ∙ ∙ ∙ ∙ ∙

From Self-Assessment to External Quality Assurance

17

QUEST

Conclusions Challenges PROCEDURES FOR NOMINATION AND APPOINTMENT Should be consistent and transparent. Define a selection profile is an important aspect of the "legitimacy" of students’ presence in the process.

From Self-Assessment to External Quality Assurance

18

TRAINING Training students in specific QA tools to enable them to develop properly their roles as evaluators. HUMAN RESOURCES The students have a temporary feature in the time they will spend at university. Regeneration and renewal. Is important to plan the human resources required while taking into account the temporary nature of the students. PROMOTION OF “QUALITY CULTURE” To encourage students who where involved in QA to contribute for the training of their peers. To continue raising awareness among students that their participation is important, that they have valuable contributions to make and that their views can help to develop and improve the system. DEVELOPMENT OF INVOLVED STUDENTS It’s necessary to provide the tools for effective participation and to ensure such participation does not jeopardize any aspect of student development (academic, social, etc.), since it means an extra effort of those who are involved.

Questions for discussion Is it important to involve students in QA? Why? How can we promote and disseminate a quality culture among the students? How can we motivate students to participate in QA? How can we facilitate student participation in QA? Convenience (advantages and drawbacks) of creating a Moldovan quality assurance student experts’ pool? Defining the profile of students: an important challenge to deal with.

3. EX ANTE EVALUATION REPORTS OF STUDY PROGRAMMES IN MOLDOVA Moldova State University Ex Ante Evaluation Presentation (RO) Programele de studii ∙ sunt servicii oferite de USM, ∙ care au drept finalitate dezvoltarea competenţelor necesare practicării unei activităţi complexe şi specific

Un program de studii constă în activităţi de ∙ proiectare, ∙ organizare, ∙ conducere şi

∙ realizare efectivă a predării, învăţării şi cercetării dintr-un domeniu ∙ care conduc la obţinerea unei calificări universitare proiectare, ∙ organizare, ∙ conducere şi ∙ realizare efectivă a predării, învăţării şi cercetării dintr-un domeniu ∙ care conduc la obţinerea unei calificări universitare

Iniţierea programului de studii SCOP: adaptarea ofertei de programe la cerinţele mediului socio-economic şi folosirea eficientă a resurselor. Drept de inițiere a programelor de studii: ∙ Catedră ∙ Departament ∙ facultate ∙ Secţia Managementul Calităţii, Evaluare și Dezvoltare curriculară,USM CONȚINUT: analizarea mediul extern şi intern al universităţii: ∙ Analiza mediului extern: SCOP → identificarea nevoii de instruire și a serviciilor educaţionale oferite de USM, comparabile cu cele oferite de alte universităţi. ∙ Analiza mediului intern: SCOP → evaluarea situaţiei existente privind programele de studii şi resursele disponibile ale USM: strategia universităţii, misiunea şi obiectivele ei specifice. From Self-Assessment to External Quality Assurance

19

Acte normative: Nomenclatorul domeniilor de formare profesională şi al specialităţilor pentru pregătirea cadrelor în instituţiile de învăţământ superior, ciclul I (Lege Nr. 142 din 07.07.2005).

Proiectarea/elaborarea programe lor de studiu la USM Responsabili: ∙ catedrele de specialitate sau/și colectivele în interiorul unui departament și Secţia Managementul Calităţii. ∙ Procesul presupune câteva etape

Etapele elaborării noilor PS Stabilirea profilului de competenţe al absolvenţilor și a standardului ocupaţional al specialistului

Definirea obiectivelor generale și specifice

Elaborarea Planului de învăţământ (se stabilesc disciplinele de studii și ponderile lor în credite) Întocmirea Listei cadrelor didactice cu competenţe adecvate disciplinelor din Planul de învăţământ, care vor presta servicii în cadrul programului de studii Elaborarea sau/și redactarea curriculumurilor disciplinelor și a stagiilor de practică aferente + Notă informativă cu privire la logistica necesară pentru asigurarea material-financiară a noului program de studii

Aprobarea noilor PS (instanţe)

•Responsabilii de elaborarea noului program de studii depun un DOSAR la Prorectoratul pentru activitate didactică.

Senatul USM •Analizează și aprobă noile PS •Solicită ME autorizarea PS

From Self-Assessment to External Quality Assurance

•Analizează PS •Autorizează noile PS

Ministerul Educației

20

Dosarul pentru autorizarea programului de studii ∙ Notă explicativă = argumentează gradul de solicitare a noii specialităţi pe piaţa muncii, identifică scopul și obiectivele noului program, condiţiile de admitere, profilul de competenţe al absolvenţilor și calificarea care îi va corespunde. ∙ Planul de învățământ = conţine unităţi de curs şi numărul de credite aferente fiecăruia, coraportate la necesităţile de formare a viitorului specialist. ∙ Lista cercetărilor științifice = conţine rezultatele activităţii ştiinţifice ale cadrelor didactice de la catedra care va asigura programul, pentru a certifica competenţa și potenţa acesteia de a asigura procesul de predare-învăţare. ∙ Lista bibliografică pe disciplinele incluse în Planul de învăţământ certifică asigurarea cu literatură de specialitate a fiecărei discipline incluse în planul de învăţământ. ∙ Asigurarea cu personal didactic, prezintă cadrele didactice care vor asigura predarea disciplinelor din Planul de învăţământ, gradul știinţific și titlul didactic, precum și disciplina pe care o va preda. ∙ Asigurarea tehnico-materială, prin care catedra trebuie să argumenteze faptul că dispune de o logistică suficientă pentru demararea noului program.

Punctele forte ∙ Elaborarea unui nou program de studiu este determinat de necesităţile pieţii muncii și demarează prin identificarea nevoilor pieţii muncii. ∙ Colaborarea intensă între autorii programului, catedrele de specialitate (în cazul programelor multidisciplinare), comisia de calitate de la facultate, secţia Managementul Calităţii, evaluare și dezvoltare curriculară, prorectorul pentru activitatea didactică. ∙ Existenţa unor criterii și a unor indicatori de evaluare a noilor programe de studiu. ∙ În elaborarea noilor programe se ţine cont de resursele știinţifico-didactice și tehnico-materiale ale USM, dar atrag și potenţial extern. ∙ Toate programele noi de studiu sunt asigurate cu pachet curricular suficient.

Puncte slabe ∙ Lipsește un Regulament care ar reglementa la nivel instituţional iniţierea, aprobarea, monitorizarea şi evaluarea periodica a programelor de studii. ∙ Nu este există o Comisie specializată instituţională care ar expertiza programele noi de studii. ∙ Lipsește în totalitate expertiza externă a programelor de studii (O Agenţie naţională de acreditare/evaluare?) care să contribuie cu sugestii, recomandări, ţinând cont de experienţa europeană sau a altor universităţi naţionale, etc.

Ex Ante Evaluation Report (RO) Programele de studii reprezintă serviciile oferite de Universitatea de Stat din Moldova și care au drept finalitate dezvoltarea competenţelor necesare practicării unei activităţi complexe şi specifice. Un program de studii constă în totalitatea activităţilor de proiectare, organizare, conducere şi realizare efectivă a predării, învăţării şi cercetării dintrun domeniu care conduc la obţinerea unei calificări universitare. Astfel, procesele de iniţiere, aprobare, monitorizare şi evaluare periodică a programelor de studii reprezintă componente ale sistemului de management al calităţii din USM, esenţiale pentru a se asigura îmbunătăţirea continuă a calităţii în educaţie. Inițierea unui nou program de studii se face pentru îmbunătăţirea activităţii USM prin adaptarea ofertei de programe la cerinţele mediului socio-economic şi folosirea eficientă a resurselor. Iniţierea programelor de studii noi se realizează la nivel de catedră/departament/facultate în comun cu Secţia Managementul Calităţii şi se bazează pe analize complexe privind mediul extern şi intern al universităţii. Universitatea evaluează contextul general și piaţa potenţială a universităţii în scopul identificării nevoii de instruire și a serviciilor educaţionale oferite de USM, comparabile cu cele oferite de alte universităţi. Programele noi de studiu se iniţiază în concordanţă cu Nomenclatorului domeniilor de formare profesională şi al specialităţilor pentru pregătirea cadrelor în instituţiile de învăţământ superior, ciclul I (Lege Nr. 142 din 07.07.2005). Analiza mediului intern se face de către Secţia Managementul Calităţii pentru evaluarea situaţiei existente privind programele de studii şi resursele disponibile ale USM (se are în vedere şi strategia universităţii, misiunea şi obiectivele ei specifice).

From Self-Assessment to External Quality Assurance

21

Notă: La USM, această fază are loc la nivelul discuţiilor și negocierilor individuale dintre participanţii la procesul de asigurare a calităţii și iniţiatorii noilor programe de studii și nu se finalizează printr-un raport care să cuprindă informaţii despre clienţi, planuri de învăţământ de la alte instituţii de învăţământ cu specializări similare, resurse existente şi necesare și care ar putea fi analizat la nivelul managementului de vârf pentru a se adopta decizii (la nivelul Senatului sau altă structură). Responsabilitatea pentru proiectarea/elaborarea noilor programe de studiu la USM este asumată de catedrele de specialitate sau/și colectivele în interiorul unui departament și Secţia Managementul Calităţii, evaluare și dezvoltare curriculară a USM. Notă: La această fază ar fi necesar ca decanul facultăţii să emită un ordin prin care să numească responsabilul/coordonatorul de program și o echipă de lucru, care să poarte răspunderea pentru proiectarea, monitorizarea și îmbunătăţirea continuă a calităţii programului de studii. Procesul de proiectare/elaborare a programului de studii presupune elaborarea unui Dosar pentru autorizarea programului de studii, prin parcurgerea următoarelor secvenţe: I. Stabilirea profilului de competenţe al absolvenţilor programului de studii și a standardului ocupaţional al specialistului. II. Definirea obiectivelor generale și specifice și elaborarea Planului de învăţământ, care sunt analizate la nivel de catedră/departament. In procesul de proiectare/elaborare a Planului de învăţământ se stabilesc disciplinele de studii și ponderile lor în credite, conform reglementărilor naţionale și instituţionale (Legea învăţământului RM din 1995, Ghidul de implementare a sistemului naţional de credite de studiu (nr. 140 din 25.02.06), Cadrul Naţional al Calificărilor, Planul-cadru pentru studii superioare (3 iunie 2011), Regulamentul instituţional cu privire la evaluarea randamentului academic din 9 iunie 2010 etc.). III. Întocmirea Listei cadrelor didactice cu competenţe adecvate disciplinelor din Planul de învăţământ. Lista este înaintată de catedrele/departamentele care vor presta servicii în cadrul programului de studii. IV. Elaborarea sau/și redactarea curriculumurilor disciplinelor din Planul de învăţământ de către titularii disciplinelor pe care le vor preda și a stagiilor de practică aferente, precum și o Notă informativă cu privire la logistica necesară pentru asigurarea material-financiară a noului program de studii. Dosarul pentru autorizarea programului de studii conţine în mod obligatoriu următoarele documente: 1. O Notă explicativă (argumentează gradul de solicitare a noii specialităţi pe piaţa muncii, identifică scopul și obiectivele noului program, condiţiile de admitere, profilul de competenţe al absolvenţilor și calificarea care îi va corespunde). 2. Planul de învăţământ (conţine cursuri obligatorii, opţionale şi la libera alegere şi numărul de credite aferente fiecăruia. Este structurat pe bază de credite transferabile, conform standardelor legale în vigoare (respectiv, programe ce se finalizează cu diplomă de licenţă 180 - 240 credite, programe de master 90 – 120 de credite); valorile în credite ale unui semestru sunt poziţionate în jurul a 30 de unităţi. Cursurile se identifică prin coraportare la necesităţile de formare a viitorului specialist, de către membrii catedrei/departamentului de specialitate. Numărul de credite acordat cursurilor este documentat prin evaluarea bibliografiei, materiei de curs şi a lucrului individual al studentului. Se păstrează un coraport de 1:1 și 1:2 pentru contactul direct și lucrul individual. 3. Lista cercetărilor știinţifice relevante pentru programul respectiv este elaborată de catedră/departament și conţine rezultatele activităţii ştiinţifice ale cadrelor didactice de la catedra/departamentul care va asigura programul, pentru a certifica competenţa și potenţa acesteia de a asigura procesul de predare-învăţare la programul respectiv. 4. Lista bibliografică pe disciplinele incluse în Planul de învăţământ certifică asigurarea cu literatură de specialitate a fiecărei discipline incluse în planul de învăţământ pentru asigurarea formării competenţelor profesionale ale viitorului specialist. 5. Asigurarea cu personal didactic, prezintă cadrele didactice care vor asigura predarea disciplinelor din Planul de învăţământ, gradul știinţific și titlul didactic, precum și disciplina pe care o va preda. 6. Asigurarea tehnico-materială, prin care catedra/departamentul/facultatea trebuie să argumenteze faptul că dispune de o logistică suficientă pentru demararea noului program. Notă: La această fază ar fi necesară o Comisie specializată universitară care să expertizeze conţinutul Dosarului depus de unităţile de iniţiativă și să prezinte Senatului un raport despre necesitatea și calitatea noului program propus.

From Self-Assessment to External Quality Assurance

22

După aprobarea Dosarului de către Consiliul Facultăţii în cadrul căreia a fost iniţiat noul program de studii, acesta este depus la Prorectorul pentru activitate didactică pentru a începe procedura de autorizare. Între timp, cadrele didactice care urmează să asigure procesul didactic la programul respectiv, elaborează curriculumuri pe disciplină, în corespundere cu normele regulamentare și cu rigorile instituţionale. Pachetul curricular este prezentat spre expertiză în Secţia Managementul Calităţii a USM. Prorectorul pentru activitate didactică propune programul spre aprobare. În baza avizelor Secţiei Managementul Calităţii a USM și a Prorectorului pentru activitatea didactică, programul este aprobat de către Senatul USM și transmis Ministerului Educaţiei al RM spre autorizare. Pentru menţinerea şi îmbunătăţirea continuă a calităţii programelor de studii, în USM se realizează monitorizarea rezultatelor învăţării şi a factorilor care le determină. Responsabilitatea pentru monitorizarea şi îmbunătăţirea continuă a programelor de studii este delegată Coordonatorilor/Responsabililor de programele de studii. Monitorizarea programelor de studii se face în mod sistematic și planificat şi presupune controlul modului în care se desfăşoară activitatea, pentru depistarea la timp a neajunsurilor şi iniţierea de acţiuni corective şi preventive care să care să asigure menţinerea şi îmbunătăţirea continuă a calităţii programelor de studii. Monitorizarea se realizează cu participarea mai multor actori: cadre didactice, conducerea catedrei/departamentului/facultăţii, Comisia de calitate de la Facultate,Secţia Managementul Calităţii a USM și Prorectorul pentru activitatea didactică. Rolul principal în monitorizarea programelor de studii revine coordonatorului/responsabilului de programul de studii, care este sprijinit de managementul facultăţii coordonatoare. La nivelul universităţii, structurile responsabile de managementul calităţii, organizează periodic audituri interne pentru verificarea respectării procedurilor şi programelor specifice proceselor educaţionale. Auditul intern al programelor de studii presupune controlul următoarelor aspecte:  Modul de îndeplinire a obiectivelor propuse prin programul de studiu.  Nivelul calitativ al tuturor activităţilor specifice programului de studiu.  Respectarea aplicării conţinuturilor prevăzute în curriculumurile disciplinelor din planul de învăţământ.  Aplicarea corectă a sistemului de evaluare a studenţilor şi urmărirea rezultatelor obţinute de studenţi în fiecare sesiune de examene.  Adaptarea continuă a programelor de studii la transformările din societate, la cerinţele pieţei şi la acumulările în planul cunoaşterii, etc. Rezultatele auditului intern se consemnează în rapoarte cu privire la calitatea procesului didactic, prezentate spre analiză Senatului USM sau Consiliului de Administrare. Analiza se finalizează prin elaborarea unor recomandări și a unui plan de măsuri pentru îmbunătăţirea calităţii programului de studii sau pentru modificarea substanţială a acestuia.

Punctele forte Punctele forte ale USM în cadrul procesului de elaborare a unui nou program sunt: 1. Elaborarea unui nou program de studiu este determinat de necesităţile pieţii muncii și demarează prin identificarea nevoilor pieţii muncii. 2. Colaborarea intensă între autorii programului, catedrele de specialitate (în cazul programelor multidisciplinare), comisia de calitate de la facultate, secţia Managementul Calităţii, evaluare și dezvoltare curriculară, prorectorul pentru activitatea didactică. 3. Existenţa unor criterii și a unor indicatori de evaluare a noilor programe de studiu. 4. În elaborarea noilor programe se ţine cont de resursele știinţifico-didactice și tehnico-materiale ale USM, dar atrag și potenţial extern. 5. Toate programele noi de studiu sunt asigurate cu pachet curricular suficient.

Puncte slabe 1. 2. 3.

Lipsește un Regulament care ar reglementa la nivel instituţional iniţierea, aprobarea, monitorizarea şi evaluarea periodica a programelor de studii. Nu este există o Comisie specializată instituţională care ar expertiza programele noi de studii. Lipsește în totalitate expertiza externă a programelor de studii (O Agenţie naţională de acreditare/evaluare?) care să contribuie cu sugestii, recomandări, ţinând cont de experienţa europeană sau a altor universităţi naţionale, etc.

From Self-Assessment to External Quality Assurance

23

Technical University of Moldova Ex Ante Evaluation Presentation (EN) Legal steps to establish a Study Program

Genesis of New Study Programs

Objectives of temporary authorization and accreditation ∙ to ensure the academic community, beneficiaries, employers and the general public that the educational institution, provisionally authorized to organize a study program or accredited, meets the minimum quality standards of a higher education institution; ∙ to determine educational institutions to engage in supporting continuous growth of academic quality, demonstrated by results in learning and research;

From Self-Assessment to External Quality Assurance

24

∙ to assist higher education institutions to develop an efficient management and a quality culture and demonstrate, through evidence and relevant documents, their condition; ∙ to determine higher education institutions to self-evaluate themselves; ∙ to identify and make public any attempt of initiation or running a program that does not meet minimum quality standards.

Stages of provisional accreditation of study programs ∙ The paper refers to master's programs but it is noted that the stages of the process for provisional accreditation and accreditation of Bachelor and Master programs are identical, with minor exceptions. According to the Regulation on the organization of master studies[2]: ∙ To obtain authorization to organize master studies, the accredited higher education institution asks the Ministry of Education for the evaluation of institutional capacity for conducting training at the respective master program. ∙ The application for authorization, submitted at least six months before the start of the Master’s program, will be accompanied by a dossier of internal evaluation of the institutional capacity, with accurate information proved by documents. ∙ Based on the evaluation of the dossier, the Ministry of Education authorizes, by order, the organization of the Master’s programs for the required specialties. ∙ The authorized Master’s program will be conducted on a provisional basis until its accreditation. Accreditation will be required after the first class of graduates from the respective Master’s program. Higher master degree studies are subject to external academic reevaluation and accreditation procedures every 5 years.

Requirements concerning the provisional authorization of study programs Mandatory requirements: ∙ institutional accreditation; ∙ existence of the internal quality assurance system; ∙ curricula, with the approval of the competent ministry (professional associations); ∙ supply with teaching materials, lecture notes and other things necessary to fully meet the needs of the study program; ∙ relevant scientific research activities in the respective field; ∙ employment / hiring of tenured teaching staff; ∙ adequate endowment of area(s) for which authorization is requested (laboratories, equipment, machinery, etc.). The normative mandatory requirements for the provisional authorization of study programs are provided in Annex 3 of the Guideline.

Internal evaluation procedures ∙ Establishment of the Self-evaluation Commission. ∙ Development of the Self-evaluation Report. ∙ The self-evaluation report and the proposals for improvement made by the Self-evaluation Commission are analyzed at the chair’s meeting. ∙ To check the self-evaluation report and formulate the Senate’s draft of decisions, a Group of auditors is formed which are specialists in academic quality audit. ∙ The chair plans the implementation of the envisaged measures. ∙ The Quality Commission of the institution / faculty includes in the monitoring plan the supervision of the implementation of the adopted action plan.

Relevant criteria ∙ labor market offer, the need for qualified staff as defined by the Program, support from employers and professional / employer associations, ∙ applicants, mechanisms that may direct them to the Program, ∙ distinct sides of the program in relation to other existing ones,

From Self-Assessment to External Quality Assurance

25

∙ human resources of respective qualification capable of ensuring the new program, ∙ didactic support, material basis, to ensure the curricular needs of the Program, ∙ existence of relevant scientific research at the university / faculty in the respective field, with important human and material potential, with outstanding results.

Weaknesses of the Guideline In the Guideline of evaluation of study programs there are outlined criteria and indicators that reflect explicitly the need for specialists, indicators of appreciating that need, the actors who must give their opinions on that appreciations, quantitative data, approvals of professional organizations, ministries, etc. There is a need to apply separately for authorization phase only the most important criteria (for setting new programs) and emphasize the necessity argument - the criterion number one (depending on the importance).

Results of surveys ∙ 2.1. Indicators that can be easily understood and administered by the promoters of the new study programs (at faculty / department level ) are: ∙ Domain B ”planning, implementation and results of the study program”, criteria B1.1, B1.2, B2.1, B2.2, B 2.5, B 3.14., B 14.3, B 4.4 B 4.5, B 5.3, B 5.4, B 5.5, B 6.1, B 6.2, B 6.4, B 8.1, B 8.2, B 9.1, B 9.2, B 9.5, B 9.6, B 9.8, B 10.1, B 10.3, B 10.4, B 10.6 and B10.7. ∙ Domain D „Students”, criteria D 3.1, D 4.1, D 4.2, D 4.5, D 5.1 and D 5.2. ∙ Domain F „material and financial resources”, criteria F 1.1, F 1.2, F 2.2, F 2.5, F 2.6, F 3.1, F 3.2, F 3.3, F 4.1, F 4.2 and F 4.3 ∙ Domain G “quality management and continuous improvement”, criteria G 1.1, G 1.2, G 1.3, G 1.4, G 2.1, G 2.2, G 2.3, G 2.4, G 3.1 and G 3.2. 2.1. Indicators that can be easily understood and administered by the promoters of the new study programs (at faculty / department level ) are:

The main indicators from the perspective of new study programs promoters ∙ B 2.5 The mission and objectives of the study program reflect the requirements / needs of stakeholders (students, graduates, employers) ∙ B 3.1 The content of the study program is oriented towards the development of skills ∙ B 4.3 The curriculum meets national and European standards ∙ B 5.5 The didactic strategies are oriented towards active student learning ∙ B 6.1 The study subjects are provided with curricular support and laboratory basis adequate for the accomplishment of the planned skills (generic and specific) ∙ B10 Authentic evaluation of academic results ∙ F 2.6 The used tools, equipment, technologies are appropriate to achieve program’s objectives and enable the effective provision of training activities

Information, advisory services provided by QMD to promoters of new programs ∙ ∙ ∙ ∙ ∙

TUM’s Quality Manual; The Procedures of TUM’s Quality System; Framework Plan; National Qualifications Framework – Higher Education – cycle I, Bachelor, cycle II, Master, Doctorate on fields; Guideline „ Criteria, indicators and assessment procedures of study programs in higher education – cycle I (Bachelor) and cycle II (Master)”; ∙ Training and consulting promoters of new programs on the provisions of the Quality Management System, TUM.

Strengths of TUM in the process of developing new study programs ∙ The existence and viability of the Quality Management System. ∙ TUM’s participation in national and international educational (TEMPUS), research (FP7) projects, etc. ∙ The existence of a team of experts and auditors in Quality Management and Assurance in higher education.

From Self-Assessment to External Quality Assurance

26

∙ Communication with external (economic agents) and internal (students) beneficiaries, measurement of their satisfaction, realization of analysis activities and continuous improvement through preventive and corrective actions based on surveys / questionnaires of beneficiaries of educational services offered by TUM. ∙ Carrying out the ex-ante internal evaluation for all master programs at TUM and a number of study programs from cycle I.

Areas of improving the process of developing new study programs ∙ Strengthening links with economic agents in order to identify the labor market needs regarding professional skills of graduates and their reflection in the set of evaluation indicators of new programs. ∙ New study programs or improvement of the existing ones and the contents of learning units in order to achieve the level of expected competence. ∙ Increasing the attractiveness of engineering study programs. ∙ Strengthening the capacities of TUM to diversify the sources of financing the institution through the internationalization of the university, widening the collaboration with economic agents and alumni. ∙ Optimization of TUM’s structure to reduce financial costs, rational use of human and material resources.

Ex Ante Evaluation Report (EN) The Evaluation of university bachelor study programs aiming at provisional authorization and accreditation Legislative basis According to the Law on Education [2, art. 37] state and private education institutions, Study Programs must be accredited. Accreditation supposes successfully undergoing two successive processes: a. Provisional Licensing / authorization of activity, which grants the higher education institutions the right to perform the education process for a certain study program and to organize admission studying; b. Accreditation, which grants the right to organize the graduation exam and to issue certified diplomas and other study documents, recognized by the Ministry of. Provisional authorization is performed for each cycle I and II study program of university studies, which results in a distinct university qualification and is granted for a period of up to one year longer than the schooling duration for the respective program. Newly proposed study programs must be provisionally authorized.

Objectives of the provisional authorization and accreditation The objectives of the provisional authorization and accreditation of study programs are specified in the Guide „Criteria, indicators and procedures for the evaluation of study programs in higher education” [4]: ∙ To assure the academic community, beneficiaries, the employers and the general public that the education institution, which is provisionally authorized or accredited to organize a study program, meets the minimal quality standards for a higher education institution; ∙ To determine the involvement of education institutions in supporting the constant improvement of academic quality, as proved by the results in learning and research; ∙ To assist higher education institutions in developing an efficient management and a quality culture and to attest their situation through tests and relevant documents; ∙ To determine higher education institutions to evaluate themselves, ∙ To identify and make public any attempt at initiating or functioning of a program, which does not correspond to the minimal standards for academic quality.

The stages of the provisional accreditation of higher education programs The work refers to master programs but it is remarked that the stages of provisional accreditation and the accreditation of bachelor and master programs are almost identical, with small exceptions. According to the Regulation on the organization of master studies [2]:

From Self-Assessment to External Quality Assurance

27

∙ In order to be authorized to organize master higher studies, the accredited education institution applies for the evaluation of the Ministry of Education regarding its institutional capacity for the realization of education at the respective master program. ∙ The application for authorization, presented at least 6 months before the master program starts its activity, will be accompanied by a file of internal evaluation of the institutional capacity, with truthful information, proven by documents. ∙ Based on the results of the file evaluation, the Ministry of Education orders the authorization of the realization of the master program for the requested specialties. ∙ The authorized master program will unfold provisionally, until it is accredited. Accreditation will be requested after the first promotion of graduates from the respective master program. Higher master studies are undergo external academic reevaluation procedures and accreditation every 5 years.

Requirements regarding provisional authorization of study programs By means of the documents made available by the education providing institution, which requests provisional authorization or accreditation and by visiting tis headquarters, the Ministry of Education checks at an early stage if the institution meets the following mandatory requirements: a. Institutional accreditation; b. Existence of an internal quality assurance system; c. Education plans, endorsed by the relevant ministry (professional associations); d. Adequate supply of didactic materials, lecture notes and other necessary items which covers the needs of the study program; e. Performing relevant scientific research in the respective field; f. Employing the didactic personnel; g. Adequate equipment of the field(s) for which authorization is requested (laboratories, paraphernalia etc.). The obligatory normative requirements for the authorization of provisional activity of study programs are enumerated in Annex 3 of the Guide “„Criteria, indicators and procedures for the evaluation of study programs in higher education, cycles I and II” [4].

Internal evaluation procedure The Procedure internal evaluation of study programs specifies the following: ∙ Formation of the Self-Evaluation Commission. ∙ Elaboration of the self-evaluation report according to the domains, criteria and quality indicators [4]. ∙ The self-evaluation Report and the improvement proposals formulated by the Self-Evaluation Commission are analyzed at the chair session. ∙ For the examination of the auto-evaluation Report and the formulation of the draft decision of the Senate / Faculty Council (as applicable), the respective governing body forms the Group of Auditors consisting of the members of the Quality Assurance Commission, members of the Senate / Council, specialists in academic quality audit. ∙ The chair plans the implementation of the envisaged measures. ∙ Institution’s / faculty’s quality commission include in the respective monitoring plans measures for the supervision of the implementation of the adopted plan of measures.

Relevant criteria In our view, at the evaluation stage with the goal of provisional authorization of study Programs, the most important criteria, which must determine its relevance, are: ∙ The supply on the labor market, argumentation of the demand for personnel holding qualifications provided by the program, support from employers and professional / patronal associations, ∙ Applicants, future students, persons ready to embrace the respective specialty or the presence of mechanisms which could determine them to, ∙ Distinctive features of the proposed program in comparison with the others, existing in the respective or other institutions,

From Self-Assessment to External Quality Assurance

28

∙ The existence of the human potential, capable of ensuring the new program (human resources of the respective qualification), ∙ The presence of a material base / support which can be used to support the program, and which could cover the Program’s curricular needs, with no additional expenses, ∙ The presence of relevant scientific research works at the chair / faculty in the respective field, with an important human and material potential and with deserving results. This is an especially important indicator, particularly for master programs.

Guide’s weaknesses The Guide for the evaluation of study programs does not mention the criteria and indicators which will explicitly reflect the need for specialists, indicators measuring this necessity, actors who are supposed to express their opinion regarding the latter, quantitative data, notices of the professional organizations, ministries etc. For the authorization stage it is necessary to request only the most important criteria (for the creation of new programs) and to concentrate on the argumentation of the necessity – number one criterion (according to its importance).

The results of the surveys performed at various levels (pro-rectors, deans, heads of chairs, relevant didactic staff) As a result of performing the opinion survey regarding the analysis of the Guide for the evaluation of study programs [4] the following aspects have been ascertained:

Indicators which will be easy to understand and managed by the promoters of the new study programs (at faculty / department level) ∙ Field B „PLANNING, REALIZATION AND OUTCOMES OF THE STUDIES PROGRAM”, criteria B1.1, B1.2, B2.1, B2.2, B 2.5, B 3.14., B 14.3, B 4.4 B 4.5, B 5.3, B 5.4, B 5.5, B 6.1, B 6.2, B 6.4, B 8.1, B 8.2, B 9.1, B 9.2, B 9.5, B 9.6, B 9.8, B 10.1, B 10.3, B 10.4, B 10.6 and B10.7. ∙ Field D „Students”, criteria D 3.1, D 4.1, D 4.2, D 4.5, D 5.1 and D 5.2. ∙ Field F „Material and financial resources”, criteria F 1.1, F 1.2, F 2.2, F 2.5, F 2.6, F 3.1, F 3.2, F 3.3, F 4.1, F 4.2 and F 4.3 ∙ Field G QUALITY MANAGEMENT AND ITS CONSTANT IMPROVEMENT, criteria G 1.1, G 1.2, G 1.3, G 1.4, G 2.1, G 2.2, G 2.3, G 2.4, G 3.1 and G 3.2.

Crucial indicators from the perspective of the promoters of new study programs Nr. crt.

Nr. ind.

Evaluation fields, quality criteria, performance indicators

1.

B 2.5

2. 3. 4. 5.

B 3.1 B 4.3 B 5.5 B 6.1

6. 7.

B10 F 2.6

Mission and objective of the studies Program reflects the requirements / needs of the interested parties / beneficiaries (students, graduates, employers) The contents of the study Program is oriented towards the formation of competences The education plan corresponds to European and national standards Didactic strategies are oriented towards student’s active learning Study disciplines are provided with curricular support and laboratory equipment which is adequate for the formation of the planned competences (generic and specific) Authentic evaluation of academic results Tools, equipment, and the technologies used are adequate for the achievement of the objectives of the Program and provides for effective education activities

Information / documentation Information / documentation or the consulting services which can be provided to the promoters of new study programs by the Quality Management Department of the Technical University of Moldova (TUM) during the

From Self-Assessment to External Quality Assurance

29

elaboration of a new study program, according to the indicators proposed in the Guide „Criteria, indicators and procedures for the evaluation of study programs in higher education – cycle I (bachelor) and cycle II (master)”. 1. TUM’s manual of quality; 2. Procedures of the TUM’s Quality System; 3. Framework-plan; 4. National Qualifications Framework – Higher education – cycle I, higher bachelor studies, cycle II, higher master studies, doctorate studies on various domains; 5. Guide „Criteria, indicators and procedures for the evaluation of study programs in higher education – cycle I (bachelor) and cycle II (master)”; 6. Training and consulting the promoters of the new study programs regarding the provisions of TUM’s Quality Management System.

TUM’s strengths in the elaboration of a new studies program 1. 2. 3. 4.

Existence and viability of the Quality Management System. TUM’s participation in national, international (TEMPUS) educational projects, FP7 research etc. Existence of a team of experts and auditors in the field of Quality Management and assurance in higher education. Communication with external (economic agents) and internal (students) and measuring their satisfaction, as well as performing activities related to the analysis and constant improvement through preventive and corrective measures based on the surveys of the beneficiaries of the educational services provided by TUM. 5. Performing internal ex-ante evaluation for all TUM master programs as well as for a series of cycle I study programs.

Field(s) of improvement of the elaboration and approval of a new study program at TUM 1. Consolidation of the interaction with economic agents with the goal of identifying and analyzing the current needs of the labor market regarding the requirements imposed to the TUM’s students concerning their professional competences and reflecting them in the set of indicators for the evaluation of new programs. 2. Elaboration of education plans for new study programs or the improvement of the existing ones as well as the contents of learning units taking into consideration the results of the education in order to obtain the expected level of competences. 3. Increasing the attractiveness of the engineering study programs through the students’ participation at various national projects initiated by economic agents. 4. Consolidation of TUM’s capacities to diversify the sources of financing the institutions through the internationalization of the university, expanding the collaboration with the national and foreign economic agents, supporting and developing the collaboration with the ALUMNI. 5. Optimization of the TUM’s structure aiming at the minimization of financial expenditures and rational use of its human and material resources.

Ex Ante Evaluation Report (RO) TODOS PETRU, BALAN STELA, NISTOR-LOPATENCO LIVIA, CHICIUC ANDREI

Evaluarea programelor de studii universitare de licenţă în vederea autorizării provizorii si acreditarii Baza legislativă Conform Legii Învăţământului [2, art. 37] instituţiile de învăţământ de stat şi privat, Programele de Studii se supun în mod obligatoriu acreditării. Actul de acreditarea presupune parcurgerea cu succes a două procese succesive: a. licențierea / autorizarea provizorie de funcţionare, care acordă dreptul instituţiilor de învăţământ superior de a desfăşura procesul de învăţământ la un anumit program de studii şi de a organiza admiterea la studii; b. acreditarea, care acordă dreptul de a organiza examen de absolvire şi a emite diplome certificate şi alte acte de studii recunoscute de Ministerul Educaţiei.

From Self-Assessment to External Quality Assurance

30

Autorizarea provizorie se face pentru fiecare program de studiu din ciclul I sau II de studii universitare care duce la o calificare universitară distinctă şi se acordă pe o durată cu cel mult un an mai lungă decât durata de şcolarizare pentru programul respectiv. Se supun autorizării provizorii programele de studiu nou propuse.

Obiectivele autorizării provizorii şi acreditării Obiectivele autorizării provizorii şi acreditării programelor de studii sunt specificate în Ghidul „Criterii, indicatori şi proceduri de evaluare a programelor de studii în învăţământul superior” [4]: ∙ să asigure comunitatea academică, beneficiarii, angajatorii şi publicul, în general, că instituţia de educaţie, autorizată provizoriu să organizeze un program de studii sau acreditată, satisface standardele minime de calitate ale unei instituţii de învăţământ superior; ∙ să determine angajarea instituţiilor de educaţie în susţinerea creşterii continue a calităţii academice, demonstrate prin rezultate în învăţare şi cercetare; ∙ să asiste instituţiile de învăţământ superior pentru a dezvolta un management performant şi o cultură a calităţii şi pentru a demonstra, prin probe şi documente relevante, starea acestora; ∙ să determine instituţiile de învăţământ superior să se autoevalueze, ∙ să identifice şi să facă publică orice tentativă de iniţiere sau funcţionare a unui program care nu corespunde standardelor minime de calitate academică.

Etapele procesului de acreditare provizorie a programelor de studii superioare Lucrare se referă la programe de master dar se menţionează că etapele procesului de acreditare provizorie şi acreditare pentru programele de licenţă şi de master sunt identice, cu mici excepţii. Conform Regulamentului cu privire la organizarea studiilor de masterat [2]: ∙ Pentru a obţine autorizaţia de organizare a studiilor superioare de masterat, instituţia de învăţământ superior acreditată solicită Ministerului Educaţiei evaluarea capacitaţii instituţionale pentru realizarea instruirii la programul respectiv de masterat. ∙ Cererea privind autorizarea, prezentată cu cel puţin 6 luni înainte de demararea programului de masterat, va fi însoţită de un dosar de evaluare internă a capacitaţii instituţionale, cu informaţii veridice şi dovedite documentar. ∙ În baza rezultatelor evaluării dosarului, Ministerul Educaţiei autorizează, prin ordin, realizarea programelor de masterat la specialităţile solicitate. ∙ Programul de masterat autorizat se va desfășura în regim provizoriu, până la acreditarea acestuia. Acreditarea se va solicita după prima promoţie de absolvenţi ai programului respectiv de masterat. Studii superioare de masterat sunt supuse procedurilor de reevaluare academica externa şi acreditare o data la 5 ani.

Cerinţe privind autorizarea provizorie a programelor de studii Prin studiul documentelor puse la dispoziţie de instituţia ofertantă de educaţie care solicită autorizarea provizorie sau acreditarea şi prin vizită la sediul acestuia, Ministerul Educaţiei verifică, într-o fază preliminară, îndeplinirea următoarelor cerinţe obligatorii: a. acreditarea instituţională; b. existenta sistemului intern de asigurare a calităţii; c. planurile de învăţământ, cu avizul ministerului de resort (asociaţiilor profesionale); d. asigurarea cu suporturi didactice, note de curs şi alte lucruri necesare care acoperă integral necesităţile programului de studiu; e. desfășurarea activităţilor de cercetare știinţifică relevantă în domeniul respectiv; f. încadrarea / angajarea personalului didactic titular; g. dotarea corespunzătoare a domeniului (domeniilor) pentru care se solicită autorizarea (laboratoare, echipamente, utilaje etc.). Cerinţele normative obligatorii pentru autorizarea de funcţionare provizorie a programelor de studii se conţin în Anexa 3 a Ghidului “Criterii, indicatori şi proceduri de evaluare a programelor de studii în învăţământul superior ciclul I, ciclul II” [4].

From Self-Assessment to External Quality Assurance

31

Procedura de evaluare internă Procedura de evaluare internă a programelor de studii prevede următoarele etape: ∙ Formarea Comisia de Autoevaluare. ∙ Elaborarea Raportul de autoevaluare în conformitate cu domeniile, criteriile şi indicatorii de calitate [4]. ∙ La şedinţa catedrei se analizează Raportul de autoevaluare şi propunerile de ameliorare formulate de Comisia de Autoevaluare. ∙ Pentru verificarea Raportului de autoevaluare şi formularea proiectului de decizii a Senatului / Consiliului Facultăţii (după caz) organul respectiv de conducere formează Grupul de auditori din rândul membrilor Comisiei de Asigurarea a Calităţii, membrilor Senatului / Consiliului, specialişti în domeniul auditului calităţii academice. ∙ Catedra planifică realizarea măsurilor preconizate. ∙ Comisia de calitate a instituţiei / facultăţii includ în planurile de monitorizare respective măsuri de supraveghere a realizării planului de măsuri adoptat.

Criterii relevante În viziunea noastră, la etapa evaluării în scopul autorizării preventive a Programelor de studii, cele mai importante criterii, care trebuie să determine relevanţa acesteia, sunt: ∙ oferta pieţei muncii, argumentarea necesităţii în cadre de calificarea definită de program, susţinere din partea angajatorilor şi a asociaţiilor profesionale / patronale, ∙ solicitanţi, viitori studenţi, persoane gata să îmbrăţişeze specialitatea respectivă sau prezenţa mecanismelor care ar putea să-i determine la aceasta, ∙ laturile distincte ale programului propus în raport cu altele existente în instituţie sau în alte universităţi, ∙ existenţa potenţialului uman, capabil să asigure noul program (resurse umane de calificarea respectivă), ∙ prezenţa bazei / suportului material care poate fi utilizată în susţinerea Programului, care ar asigura necesităţile curriculare ale Programului, fără cheltuieli suplimentare, ∙ prezenţa cercetărilor ştiinţifice relevante la catedră / facultate în domeniul respectiv, cu un potenţial uman şi material important, cu rezultate meritorii. Acesta este un indicator deosebit de important, în special pentru programele de masterat.

Parţi slabe ale Ghidului În Ghidul de evaluarea a programelor de studii nu sunt evidenţiate criterii şi indicatori care să reflecte explicit necesitatea în specialişti, indicatorii de apreciere a acestei necesităţii, actorii care trebuie să expună pe marginea respectivei aprecieri, date cantitative avizări ale organizaţiilor profesionale, ministerelor etc. Este nevoie să solicităm separat pentru etapa de autorizare doar cele mai importante criterii (pentru crearea de noi programe) şi de pus accent pe argumentarea necesităţii – criteriul numărul unu (după importanţă).

Rezultatele sondajelor realizate la diverse niveluri (prorectori, decani, directori de departament, cadre didactice relevante) În urma realizării sondajului de opinii privind analiza Ghidului de evaluare a programelor de studii [4] s-au constat următoarele:

Indicatori care vor putea fi uşor înţeleşi şi administraţi de către promotorii noilor programe de studiu (la nivel de facultate/departament) ∙ Domeniul B „PLANIFICAREA, REALIZAREA ŞI REZULTATELE PROGRAMULUI DE STUDII”, criteriile B1.1, B1.2, B2.1, B2.2, B 2.5, B 3.14., B 14.3, B 4.4 B 4.5, B 5.3, B 5.4, B 5.5, B 6.1, B 6.2, B 6.4, B 8.1, B 8.2, B 9.1, B 9.2, B 9.5, B 9.6, B 9.8, B 10.1, B 10.3, B 10.4, B 10.6 şi B10.7. ∙ Domeniul D „Studenți”, criteriile D 3.1, D 4.1, D 4.2, D 4.5, D 5.1 şi D 5.2. ∙ Domeniul F „Resurse materiale şi financiare”, criteriile F 1.1, F 1.2, F 2.2, F 2.5, F 2.6, F 3.1, F 3.2, F 3.3, F 4.1, F 4.2 şi F 4.3 ∙ Domeniul G MANAGEMENTUL CALITĂȚII ŞI ÎMBUNĂȚĂȚIREA CONTINUĂ, criteriile G 1.1, G 1.2, G 1.3, G 1.4, G 2.1, G 2.2, G 2.3, G 2.4, G 3.1 şi G 3.2.

From Self-Assessment to External Quality Assurance

32

Indicatorii primordiali din perspectiva promotorilor noilor programe de studiu Nr. crt.

Nr. ind.

Domenii de evaluare, criterii de calitate şi indicatori de performanță

1.

B 2.5

2. 3. 4. 5.

B 3.1 B 4.3 B 5.5 B 6.1

6. 7.

B10 F 2.6

Misiunea şi obiectivele Programului de studii reflectă cerinţele / necesităţile părţilor interesate / beneficiarilor (studenţi, absolvenţi, angajatori) Conţinutul Programului de studii este orientat spre formare de competenţe Planul de învăţământ corespunde standardelor europene şi naţionale Strategiile didactice sunt orientate spre învăţarea activă a studentului Disciplinele de studii sunt asigurate cu suport curricular şi baza de laborator adecvate atingerii competenţelor planificate (generice şi specifice) Evaluarea autentică a rezultatelor academice Utilajele, echipamentele, tehnologiile utilizate sunt adecvate realizării obiectivelor Programului şi permite asigurarea efectivă a activităţilor de instruire

Informaţia / documentaţia Informaţia / documentaţia sau serviciile consultative care pot fi furnizate promotorilor noilor programe de către Departamentul de Managementul Calităţii al UTM în cadrul procesului de elaborare a unui nou program de studiu, conform indicatorilor propuşi în Ghidul „Criterii, indicatori şi proceduri de evaluare a programelor de studii în învăţământul superior – ciclul I (licenţă) şi ciclul II (masterat)”. 1. Manualul calităţii UTM; 2. Procedurile Sistemului Calităţii UTM; 3. Plan-cadru; 4. Cadrul Naţional al Calificărilor - Învăţământ superior – ciclul I, studii superioare de licenţă, ciclul II, studii superioare de masterat, doctorat pe domenii; 5. Ghidul „Criterii, indicatori şi proceduri de evaluare a programelor de studii în învăţământul superior – ciclul I (licenţă) şi ciclul II (masterat)”; 6. Instruirea şi consultarea promotorilor noilor programe privind prevederile Sistemului de Management al Calităţii UTM.

Punctele forte ale UTM în cadrul procesului de elaborare a unui nou program de studii 1. Existenţa şi viabilitatea Sistemului de Management al Calităţii. 2. Participarea UTM în proiectele naţionale şi internaţionale (TEMPUS) educaţionale, FP7 cercetare etc. 3. Existenţa unei echipe de experţi şi auditori în domeniul Managementului şi Asigurării Calităţii în învăţământul superior. 4. Comunicarea cu clienţii externi (agenţii economici) şi interni (studenţii) şi măsurarea satisfacţiei acestora, precum şi realizarea activităţilor de analiză şi îmbunătăţire continuă prin acţiuni preventive şi corective în baza sondajelor beneficiarilor serviciilor educaţionale oferite de UTM. 5. Realizarea evaluării interne ex-ante pentru toate programele de masterat de la UTM şi a unui şir de programe de studii de la ciclul I.

Domeniu(ii) de îmbunătăţire a procesului de elaborare şi aprobare a unui nou program de studii în cadrul UTM 1. Fortificarea legăturilor cu agenţii economici în vederea identificării şi analizei necesităţilor actuale ale pieţei muncii privind cerinţele impuse absolvenţilor UTM vizând competenţele profesionale ale acestora şi reflectarea acestora în setul de indicatori de evaluare a programelor noi. 2. Elaborarea planurilor de învăţământ pentru noile programe de studii sau perfecţionarea celor existente şi a conţinuturilor unităţilor de învăţare luând în considerare finalităţile de studii în vederea atingerii nivelului de competenţe scontat. 3. Creşterea atractivităţii programelor de studii inginereşti prin participarea studenţilor în diverse proiecte naţionale iniţiate de agenţii economici.

From Self-Assessment to External Quality Assurance

33

4. Fortificarea capacităţilor UTM de a diversifica sursele de finanţare a instituţiei prin internaţionalizarea universităţii, lărgirea relaţiilor de colaborare cu agenţii economici din ţară şi din străinătate, susţinerea şi deyvoltarea relaţiilor de colaborare cu ALUMNI. 5. Optimizarea structurii UTM în vederea reducerii cheltuielilor financiare şi utilizării raţionale a resurselor umane şi materiale.

State University of Medicine and Pharmacy ”Nicolae Testemițanu” Ex Ante Evaluation Presentation (EN) OLGA CERNEȚCHI, VICE RECTOR

Context The aim of existent curriculum of SUMPh ”Nicolae Testemiţanu” is general medical education through the promotion of a set of knowledge, practical skills and competences, which contributes to the formation of skilled doctors and pharmacists, with human and communication qualities, regardless of the specialty they are going to choose. Currently, the curriculum of University Faculties is classical, linear, based on disciplines. The study program comprises fundamental disciplines, specialty and socio-humanities disciplines, which are structured in mandatory and optional disciplines. The study process is formed of theoretical courses, seminars and practical lessons, clinical internships, optional courses and diploma thesis, as a component of the graduation exam. The study program is structured in 2 cycles: preclinical (study years I-III) and clinical (years IV-VI). Students who do not accumulate 60 credits (ECTS) at the end of each academic year are not promoted to the next year. With the aim to implement the curricular reform according to the Development Strategy of the University, the recommendations of international experts and the needs to adapt the university curriculum to the European higher medical education standards, there were formed Curricular Committees at the Medicine, Dentistry and Pharmacy Faculties for the development of a new study plan at these specialties, which was to enter into force on 1st September 2011. It was developed the Terms of Reference of the Curricular Committees. Depending on the profiles (internal medicine, surgery, community medicine, fundamental sciences, pharmaceutics, dental medicine, etc.) there were formed more sub-committees which include: ∙ Experiences teaching staff (professors, head of chairs, associate professors) ∙ Young teaching staff (associate professors, lecturers) ∙ Students ∙ Residents who graduated from SUMPh ”Nicolae Testemiţanu” ∙ Practical doctors and pharmacists working in the Healthcare System of Moldova

Activities of curricular subcommittees There were analyzed the analytical programs for each discipline in order to indentify and exclude outdated material and bibliographic sources. There were determined the laboratory techniques utilities for preclinical disciplines and practical manipulations for clinical disciplines. It was minimized the repetition of material. There were unified the definitions, classifications and practical competences at interdisciplinary level. It was analyzed the number of hours dedicated to disciplines, as well as their distribution through comparison analysis with study plans from EU in order to facilitate the academic mobility. The coordinators of subcommittees submitted the proposals for curricular reform for disciplines and modules to the Curricular Committee.

From Self-Assessment to External Quality Assurance

34

Description of Distribution of Responsibilities in the Process of Development and Monitoring of Records for Institutional Approval ∙ Heads of curricular subcommittees – revision of material according to disciplines, horizontal and vertical integration of disciplines ∙ Heads of Curricular Committees according to faculties – integration of data submitted be subcommittees, optimization of the number of hours, propose new mandatory and optional disciplines, optimization of clinical internship ∙ Deanship (Deans and vice-deans) – development of new study programs based on recommendations of Curricular Committees, aligned with the requirements of national legal documents, ensure logistic support for the activities of committee and subcommittees, introduction of new mandatory and optional disciplines, introduction of diploma thesis as mandatory element for the graduation exam, optimization of clinical internship, introduction of practical internship for students at Pharmacy Faculty ∙ Didactic Division – ensure logistic and advisory support for curricular committees and subcommittees activities, harmonization of new study programs, interfaculty integration of new study programs at university level ∙ Vice-rector for Quality Assurance and Integration in Education – monitoring of activities of curricular committees and subcommittees, deanships, didactic division

The trajectory of Approving a New Study Program ∙ Curricular subcommittees ∙ Curricular committees of faculties submitted the study programs in the form of a set of documents to the faculties committees ∙ Approval of study programs at faculties ∙ Approval of study programs at the Senate of SUMPh ”Nicolae Testemitanu” ∙ Approval of study programs at the Ministry of Health and Ministry of Education of Moldova

Normative Acts Followed by the Curricular Committees in their Activity ∙ WFME (World Federation for Medical Education) criteria on the organization of higher medical education. ∙ Directive 2005/36/CE of the European parliament and of the Council from 7 September 2005 on the recognition of professional qualifications. ∙ Education Law, No 547 from 21.07.1995. ∙ Law on the approval of the Nomenclator of areas of professional formation and specialties for the training of staff in higher education institutions, cycle 1, no. 142 from 07.07.2005. ∙ Law on the approval of Regulation on evaluation and accreditation of education institutions, No. 423 from 04.06.1999. ∙ Regulation on the organization of studies in higher education based on the National System of Study Credits, Order of the Ministry of Education no. 726 from 20.09.2010. ∙ Framework Regulation of the chair of higher education institution, Order no. 671 from 06.08.2010. ∙ Regulation on the training of international students in higher education institutions from Moldova, approved by Government Decision No. 746 from 21.06.2003. ∙ Charter of Public Institution State University of Medicine and Pharmacy „Nicolae Testemiţanu" from Moldova with subsequent amendments. ∙ Guide on the implementation of SNCS. ∙ Framework-plan for 1st cycle of study (higher education).

Indicators that Are Easy to Understand (Faculty/Department) of New Study Programs

and

Administrate

by

the

Promoters

∙ Level of satisfaction of beneficiaries (students) on the quality of medical and pharmaceutical education ∙ Level of satisfaction of beneficiaries of the practical skills acquired within the study program necessary to exercise the profession of doctor/pharmacist

From Self-Assessment to External Quality Assurance

35

∙ Level of satisfaction of beneficiaries of the communication skills acquired within the study program necessary to exercise the profession of doctor/pharmacist ∙ Level of satisfaction of beneficiaries of the optional academic offer ∙ Level of satisfaction of beneficiaries of the communication between students and academic staff ∙ Level of involvement of students in research ∙ Number of academic mobilities of students and teaching staff to European Universities ∙ Rate of graduates of integrated medical and pharmaceutical education involved in postgraduate education through residency and master ∙ Rate of graduates of postgraduate education in medical and pharmaceutical education employed in Healthcare System of Moldova ∙ Rate of international graduates of integrated medical and pharmaceutical education employed in medical institutions abroad ∙ Level of satisfaction of public healthcare institutions from Moldova on the level of training of doctors and pharmacists, graduates of SUMPh ”Nicolae Testemiţanu”.

SWOT Analysis of Existing Study Programs of SUMPh STRENGTHS Tendency to comply the education offers with the WHO requirements, the provisions of Bologna Declaration, and requirements of the healthcare system. 2. Instruction provided in international languages. 3. Existence and functioning of Curricular Reform Committees. Continuous up-dated of study programs by adjusting them to European requirements. 4. Implementation of the SNCS on a law basis. 5. Encourage the academic mobility of students by applying the ECTS. 6. High qualified teaching staff, ensures the formation of professional skills in graduates necessary for professional activity. 7. Existence of policies and incentives to use modern teaching/learning/testing technologies 8. Early contact with clinical disciplines (primary medical emergency; clinical internship – clinical content in the course of preclinical cycle) 9. Diversification of optional courses for study years IV–VI. 10. Presence in the curriculum for preclinical study years of some disciplines that helps the student understand the principles of research; biostatistics, research methodology 11. The advantage of direct contact with the patients from clinics, which is specific for medical education in Moldova 12. Involvement of students in extracurricular scientific activities, international conferences with the presentation of scientific results

13. The existence in the curriculum of credits for preparation of diploma thesis; this is presented as a task at the graduation exam 14. Utilization of guides and clinical protocols in educational process 15. Introduction in the curriculum the training in the Centre for Training and Testing of Practical Skills through simulation

OPPORTUNITIES The dynamics of labor market imposes continuous up-dated educational offer 2. Extended possibilities to harmonize the study programs to the European requirements in the sector regulated area of formation

THREATS 1. Imperfect legislation, the existence of gaps and contradictory legal provisions 2. Danger of insufficient financial resources required for the maintenance of adequate material base. 3. Seclusion in the old paradigm curricular

1.

1.

From Self-Assessment to External Quality Assurance

WEAKNESSES Number of hours much higher in comparison with the EU universities. 2. The teaching methods are predominantly classical, it is necessary to adjust them to modern teaching methods and evidence based. 3. Weak connection of vertical integration of fundamental knowledge provided by biomedical sciences with knowledge and practical skills from the second cycle 4. Difficulties of understanding by students of chemical, biological, fundamental due to the advanced level of knowledge required in comparison to the level of knowledge obtained at bachelor level. 5. Decreased number of students involved in research activities 6. The difference of quality between the diploma thesis and the lack of a specialized software that will verify the originality of the thesis 7. Insufficient laboratory equipment and teaching supplies 8. There is not developed the Terms of Reference with regard to practical abilities for all disciplines 1.

36

3. 4. 5.

6. 7.

8.

Reorganization of education process by implementing the training Diversification of the offer of optional and facultative courses Optimization of the methodology of choice and subscription for optional courses, which starting with next year will be on-line after the implementation of a program dedicated to this purpose Extend student mobility abroad Development of international projects in partnership with European universities. Continuous encouragement to participate in national and international projects for funding the didactic activities Implementation in integrated informational system, utilization of the system for efficient communication and transparency during the study process

4. 5. 6.

Teaching staff resistant changes Continuous increase of students number may affect the quality of educational process Migration of teaching staff to other areas of activities

Ex Ante Evaluation Presentation (RO) Context Scopul curriculei actuale a USMF ”Nicolae Testemiţanu” este educaţia medicală generală prin promovarea unui set de cunoştinţe, abilităţi practice şi atitudini care să contribuie la formarea medicilor și farmaciștilor competenţi, cu calităţi umane şi de comunicare îndifirent de specialitatea pe care îşi vor alege. În prezent curricula Facultăţilor universităţii este clasică, liniară, bazată pe discipline. Planul de învăţământ cuprinde discipline fundamentale, discipline de specialitate şi socio–umanistice, care sunt structurate în discipline obligatorii şi opţionale. Studiile cuprind cursuri teoretice, seminare şi lucrări practice, stagii clinice, cursuri opţionale şi teza de diplomă, drept componentă a Examenului de Stat de Absolvire. Programul de învăţământ este structurat pe 2 cicluri: preclinic (anii I–III) și clinic (anii IV–VI). Studenţii care nu acumulează integral 60 credite ECTS la sfârşitul fiecărui an de studii nu sunt promovaţi în următorul an. În scopul realizării reformei curriculare, în temeiul Strategiei de dezvoltare a Universităţii, propunerile experţilor externi şi necesităţile de adaptare a curriculei universitare către standardele învăţământului superior medical european, prin ordinul Rectorului, s–au format Comisiile Curriculare a Facultăţilor Medicină, Stomatologie și Farmacie pentru elaborarea noului plan de învăţământ la specialităţile vizate, care urma să intre în vigoare de la 1 septembrie 2011. A fost elaborat caietul de sarcini, privind activitatea Comisiilor Curriculare. În funcţie de profiluri (medicină înternă, chirurgie, medicină comunitară, ştiinţe fundamentale, farmaceutice, medicină dentară etc.) s–au format mai multe subcomisii. În componenţa subcomisiilor, au fost incluse: ∙ cadre didactice cu experienţă (profesori universitari, șefi catedră, conferenţiari), ∙ cadre didactice tinere (conferenţiari, asistenţi), ∙ studenţi, ∙ rezidenţi absolvenţi ai USMF ”Nicolae Testemiţanu”, ∙ medici și farmaciști practicieni, care activează în sistemul Ocroditii Sănătăţii din Republica Moldova.

Activităţile subcomisiilor curriculare ∙ au fost analizate programele analitice la fiecare disciplină, pentru identificarea şi excluderea materialului şi surselor bibliografice depăşite; ∙ s–au apreciat utilităţile tehnicilor de laborator la disciplinile preclinice şi manoperilor practice existente la cele clinice; ∙ s–a minimalizat repetarea aceluiaşi material; ∙ s–au unificat definiţiile, clasificările şi competenţele practice la nivel interdisciplinar; ∙ s-a analizat cuantumul de ore destinate disciplinelor, cât şi de plasamentul lor prin analiza comparativă cu planurile de învăţământ din UE, pentru a facilita o ulterioară mobilitate academică; ∙ coordonatorii subcomisiilor au prezentat Comisiei Curriculare propunerile de reformă a curiculei pe disciplini și module

From Self-Assessment to External Quality Assurance

37

Descrierea distribuirii responsabilităţilor ∙ Șefii subcomisiilor curriculare – Revizuirea materialului factologic pe disciplini de studii, integrarea disciplinelor pe orizontală și verticală. ∙ Șefii Comisiilor curriculare pe facultăți – Integrarea datelor parvenite din subcomisii, optimizarea numărului de ore, propunerea disciplinelor noi obligatorii și opţionale, optimizarea stagiului clinic. ∙ Biroul facultăților (Decanii și vicedecanii) – elaborarea programelor noi de studii în baza propunerilor Comisiilor curriculare, armonizate cu cerinţele actelor normative naţionale, asigurarea suportului logistic în activităţile comisiilor și subcomisiilor, introducerea disciplinelor noi obligatorii și opţionale, introducerea tezelor de diplomă drept element obligatoriu al Examenelor de Stat, optimizarea stagiului clinic, introducerea stagiului practic de Stat pentru studenţii facultăţii Farmacie. ∙ Secția didactică – asigurarea suportului logistic și consultativ în activităţile comisiilor și subcomisiilor curriculare, armonizarea programelor noi de studii, integrarea interfacultativă a programelor noi de studii la nivel de universitate. ∙ Prorector pentru Asigurarea calității și integrării în învățământ – monitorizarea activităţii comisiilor și subcomisiilor curriculare, biroului facultăţilor, secţiei didactice.

Traiectoria de aprobarea unui nou program de studiu ∙ Subcomisiile curriculare; ∙ Comisiile curriculare ale facultăţilor au prezentat Consiliilor facultăţilor programele de studii prezentate sub forma unui pachet de documente; ∙ Aprobarea programelor de studii la facultăţi; ∙ Aprobarea programelor de studii la Senatul USMF ”Nicolae Testemișanu”; ∙ Aprobarea programelor de studii la Ministerul Sănătăţii și Ministerul Educaţiei Republicii Moldova.

În cadrul elaborării curriculei Comisiile s-au condus de următoarele acte normative în vigoare ∙ Criteriile WFME (World Federation for Medical Education) de organizare a învăţământului medical superior. ∙ Directiva 2005/36/CE a Parlamentului European și a Consiliului din 7 septembrie 2005 privind recunoașterea calificărilor profesionale. ∙ Legea învăţământului, Nr. 547 din 21.07.1995. ∙ Legea privind aprobarea Nomenclatorului domeniilor de formare profesională şi specialităţilor pentru pregătirea cadrelor în instituţiile de învăţământ superior, ciclul I, nr. 142 din 07.07.2005. ∙ Legea privind aprobarea Regulamentului de evaluare şi acreditare a instituţiilor de învăţământ, Nr. 423 din 04.06.1999. ∙ Regulamentul de organizare a studiilor în învăţământul superior în baza Sistemului Naţional de Credite de Studiu, Ordinul Ministerului Educaţiei nr. 726 din 20.09.2010. ∙ Regulament – cadru al catedrei instituţiei de învăţământ superior, Ordinul nr. 671 din 06.08.2010. ∙ Regulamentului cu privire la instruirea străinilor în instituţiile de învăţământ din Republica Moldova, Aprobat prin Hotărârea Guvernului Republicii Moldova Nr. 746 din 21.06.2003. ∙ Carta Instituţiei Publice Universitatea de Stat de Medicină şi Farmacie „Nicolae Testemiţanu" din Republica Moldova cu modificările şi completările ulterioare. ∙ Ghidul de implementare a SNCS. ∙ Plan-cadru pentru ciclul I de studii (studii superioare de licenţă).

Indicatori care vor putea fi ușor înţeleși și administraţi de către promotorii (Facultate / Departament) noilor programe de studiu ∙ Gradul de satisfacţie a beneficiarilor (studenţilor) de calitatea învăţământului medical și farmaceutic oferit; ∙ Gradul de satisfacţie a beneficiarilor de nivelul abilităţilor practice achiziţionate în cadrul programului de studii necesare exercitării profesiei de medic/farmacist; ∙ Gradul de satisfacţie a beneficiarilor de nivelul abilităţilor de comunicare achiziţionate în cadrul programului de studii necesare exercitării profesiei de medic/farmacist;

From Self-Assessment to External Quality Assurance

38

∙ ∙ ∙ ∙ ∙

Gradul de satisfacţie a beneficiarilor de oferta de discipline opţionale; Gradul de satisfacţie a beneficiarilor de comunicarea dintre studenţi și cadre didactice; Rata de antrenare în cercetarea știinţifică a studenţilor; Numărul de mobilităţi academice ale studenţilor și cadrelor didactice cu universităţile din Europa; Rata absolvenţilor învăţământului integrat medical și farmaceutic antrenaţi la studii postuniversitare prin rezidenţiat și masterat; ∙ Rata absolvenţilor studiilor postuniversitare în învăţământul medical și farmaceutic angajaţi în sistemul Ocrotirii Sănătăţii din Republica Moldova; ∙ Rata absolvenţilor internaţionali ai învăţământului integrat medical și farmaceutic angajaţi în instituţiile medicale de peste hotare; ∙ Gradul de satisfacţie a instituţiilor medico-sanitare publice din Republica Moldova de nivelul pregătirii medicilor și farmaciștilor absolvenţi ai USMF ”Nicolae Testemiţanu”.

Analiza SWOT a programelor de studii existente în USMF PUNCTE TARI 1. Tendinţa de conformare a ofertei educaţionale la cerinţele OMS, prevederile Procesului de la Bologna, necesităţile sistemului de sănătate. 2. Proces didactic oferit în limbile de circulaţie internaţională. 3. Existenţa şi funcţionalitatea Comisiei de Reformă Curriculară Actualizarea permanentă a conţinutului programelor de studiu la disciplinele prin adaptarea acestora la cerinţele europene . 4. Implementarea prin lege a SNCS. 5. Facilitarea mobilităţilor studenţeşti prin aplicarea Sistemului de Credite Transferabile . 6. Înalta calificare a cadrelor didactice asigură formarea unor competenţe profesionale ale absolvenţilor necesare în desfăşurarea cu succes a profesiei. 7. Existenţa unor politici şi posibilităţi de încurajare a utilizării tehnologiilor moderne de predare / învăţare / testare. 8. Contactul precoce cu disciplinele clinice (Urgenţa medicală primară; Stagiu clinic – conţinut clinic în cursul ciclului preclinic). 9. Diversificarea cursurilor opţionale la anii IV–VI. 10. Prezenţa în curriculă în anii preclinici a unor materii care ajută studentul la înţelegerea principiilor cercetării ştiinţifice: Biostatistica. Metodologia cercetării ştiinţifice. 11. Avantajul contactului direct cu pacienţii din clinici, care caracterizează învăţământul medical din Moldova.

From Self-Assessment to External Quality Assurance

12. Implicarea studenţilor în activitatea cercurilor ştiinţifice studenţeşti, participarea la conferinţe naţionale şi internaţionale cu prezentarea rezultatelor cercetării. 13. Existenţa în curriculă a creditării pregătirii tezei de diplomă; aceasta se prezintă în cadru organizat, ca probă în cadrul examenului de Stat de absolvire. 14. Utilizarea ghidurilor şi protocoalelor clinice în procesul educaţional. 15. Introducerea pregătirii în Centrul de instruire şi testare a deprinderilor practice prin simulare. PUNCTE SLABE 1. Numărul de ore mult mai mare comparativ cu universităţile din comunitatea europeană. 2. Orientarea metodelor de predare este predominant clasică, fiind necesară o mai mare adaptabilitate la metodele moderne şi cu rezultate dovedite. 3. Slabă conexiune a integrării verticale a cunoştinţelor fundamentale furnizate de ştiinţele biomedicale cu cunoştinţele şi abilităţile practice din al doilea ciclu. 4. Dificultăţi de înţelegere de către studenţi a proceselor chimice, biologice, fundamentale datorită nivelului avansat al cunoştinţelor faţă de cunoştinţele de bază din liceu. 5. Numărul scăzut de studenţi implicaţi în activităţi de cercetare. 6. Diferenţa de calitate între lucrările de diplomă şi inexistenţa unui soft specializat care să verifice originalitatea lucrărilor studenţilor. 7. Dotarea insuficientă a catedrelor cu utilaj de laborator şi consumabile necesare procesului didactic. 8. Nu este elaborat caietului de abilităţi practice pentru toate disciplinele.

39

7.

8.

OPORTUNITĂȚI 1. Dinamica pieţei muncii impune o actualizare permanentă a ofertei educaţionale. 2. Posibilităţi extinse de armonizare a programelor de studiu cu cerinţele europene în domeniul de formare reglementat sectorial. 3. Reorganizarea procesului educaţional prin implementarea învăţământului prin simulare 4. Diversificarea ofertei de cursuri opţionale și facultative. 5. Optimizarea metodologiei de alegere şi înscriere la cursurile opţionale, care din anul viitor se va face on– line, după construcţia unui program dedicat acestui scop. 6. Extinderea mobilităţilor studenţeşti, în străinătate.

Dezvoltarea de proiecte internaţionale în parteneriat cu universităţile europene. Stimularea permanentă a participării la proiecte naţionale şi internaţionale în vederea finanţării activităţii didactice. Implementarea sistemului informaţional integrat, utilizarea lui pentru comunicare eficientă şi transparentă în tot procesul educaţional.

AMENÎNȚĂRI 1. Legislaţie imperfectă, existenţa lacunelor şi a prevederilor legale care vin în contradicţie. 2. Pericolul insuficienţei resurselor financiare necesare întreţinerii unei baze materiale adecvate. 3. Închistarea în vechile paradigme curriculare. 4. Rezistenţa la schimbare a cadrelor didactice. 5. Creşterea constantă a numărului de studenţi poate afecta calitatea actului educaţional. 6. Migrarea cadrelor didactice în alte domenii de activitate

Ex Ante Evaluation Report (EN) OLGA CERNEȚCHI, PRO-RECTOR FOR QUALITY ASSURANCE AND INTEGRATION IN EDUCATION, AND ȘAPTEFRAȚI LILIAN, HEAD OF DIDACTIC DIVISION The goal of the current curricula of the SUMP “Nicolae Testemiţanu” is the general medical education through the promotion of a set of knowledge, practical abilities and attitudes which will contribute to the training of competent doctors and pharmacists, with humane and communication qualities independently of the chosen specialty. Currently, the curricula of the university’s Faculties is classic and linear and one which is based on disciplines. The education plan contains fundamental, specialty and social-humanistic disciplines which are structured in obligatory and optional ones. The studies contain theoretical courses, seminars and practical studies, clinical internships, optional courses and the diploma thesis, as a component of the State Graduation Exam. The education program is structured over 2 cycles: preclinical (years I–III) and clinical (years IV–VI). Students who do not achieve integrally 60 ECTS credits by the end of each studying year will not be promoted to the following year. Aiming at reforming the curriculum, based on the Development Strategy of the University, the initiatives of the external experts and the necessity for the adaptation of the university curricula to the European higher medical education standards, through the order of the Rector, the Curricular Commissions of the Faculty of Medicine have been created for the elaboration of a new education plan for the respective specialties. An agenda has been elaborated for the Curricular Commissions. Depending on the profiles (internal medicine, surgery, communitarian medicine, fundamental and pharmaceutical sciences, dental medicine etc.) a series of sub-commissions have been created. Subcommissions consist of experienced staff (university professors, heads of departments, associates), young didactic staff (associates, assistants), students, residents – graduates from the SUMP ”Nicolae Testemiţanu”, doctors and practicing pharmacists, who activate within the Health System of the Republic of Moldova. Hence, the analytical programs for each discipline have been analyzed for the identification and exclusion of obsolete material and bibliographic sources; an evaluation has been performed of the utilities of the laboratory techniques for the existing pre-clinical disciplines and practical workmanship existing at the clinical ones; repetition of the same material has been minimized; definitions, classification and practical competences at the interdisciplinary level have been unified. The coordinators of the sub-commissions have presented the Curricular Commission with their proposals regarding the reform of the curricula based on disciplines, modules. Taking these proposals into consideration as well as the recommendations of the experts and analyzing the curricula of the partner faculties of Medicine: „Victor Babeş”– Timişoara; „Iuliu Haţieganu” – Cluj Napoca; „Gr. T. Popa”– Iaşi; Univerșite D'Angers – Franţa; Scool of Medical

From Self-Assessment to External Quality Assurance

40

Sciences UMC Utrecht, the Deanships of the faculties, jointly with the the heads of the respective disciplines have performed a re-evaluation of the curricula and a first adaptation, elaborating in 2011 the new Education Plan. It is worth mentioning that the current Education Plan keeps track of the number of hours envisaged for the disciplines, as well as their placement through a comparative analysis with the education plans from the EU, aiming at the facilitation of the future academic mobility. During the elaboration of the curricula the following normative acts currently in force have served as guides: 1. WFME criteria (World Federation for Medical Education) for the organization of the higher medical education. 2. Directive 2005/36/CE of the European Parliament and Council from September 7th 2005 on the recognition of professional qualifications. 3. Law on Education, Nr. 547 from 21.07.1995. 4. Law on the approval of the Classification of fields of professional formation and specialties for the training of staff in higher education institutions cycle I, nr. 142 from 07.07.2005. 5. Law on the approval of the Regulation on the evaluation and accreditation of education institutions, Nr. 423 from 04.06.1999. 6. Regulation on the organization of studies in higher education based on the National System of Study Credits, Order of the Ministry of Education nr. 726 from 20.09.2010. 7. Regulation – framework of the higher education institution, Order nr. 671 from 06.08.2010. 8. Regulation on the training of the foreigners in education institutions of the Republic of Moldova, approved through the Decision of the Government of the Republic of Moldova Nr. 746 from 21.06.2003. 9. Map of the Public Institution State University of Medicine and Pharmacy „Nicolae Testemiţanu" from the din Republic of Moldova with the subsequent amendments and completions. 10. Guide for the implementation of SNCS 11. Framework-plan for studies cycle I (higher undergraduate studies). Subsequently, faculties’ curricular commissions have presented the study programs to the Councils of the faculties in the shape of a packet of documents which include: ∙ General and specific objectives of the program; ∙ Education plan with the weights of the disciplines expressed through SNCS study credits and with the disciplines ordered successively over the schooling time; ∙ Thematic programs or the syllabus included in the education plan. After the approval of the study programs at the faculties, follows their approval at the Senate of the SUMP ”Nicolae Testemiţanu”, Ministry of Health and the Ministry of Education of the Republic of Moldova.

Description of the distribution of responsibilities in the process of elaboration and monitoring of the files for institutional approval During the elaboration of new study programs responsibilities have been divided as follows: 1. Heads of curricular sub-commissions – revision of the facts material on study disciplines, integration of disciplines horizontally and vertically. 2. Heads of the curricular commissions on faculties – Integration of data originating from sub-commissions, optimization of the number of hours, proposal of new obligatory and optional disciplines for: students’ familiarization with the history of the higher medical and pharmaceutical education; education techniques and the fundamentals of informational culture; methodology of scientific research, ensuring early contact with patients, optimization of clinical internships. 3. Offices of faculties (Deans and deputy deans) – Elaboration of new study programs based on the proposals of the Curricular Commissions, harmonized with the national normative acts, providing logistical support for the activity of commissions and sub-commissions, introduction of new obligatory and optional disciplines, introduction of diploma theses an obligatory element of the State Exam, optimization of the State clinical internships for the students of the Pharmacy faculty. 4. Didactic section – providing the logistic and consulting support in the activities of the curricular commissions and sub-commissions, harmonizing new study programs, interfaculty integration of new study programs at the university level.

From Self-Assessment to External Quality Assurance

41

5. Deputy Rector responsible for quality and integration assurance in education – monitoring of the activities of the curricular commissions and sub-commissions, faculties’ bureau, didactic section.

Indicators which will be easily understood and administered by the promoters (Faculty / Department) of new study programs 1. The degree of satisfaction of the beneficiaries (students) with the quality of the offered medical and pharmaceutical education; 2. The degree of satisfaction of the beneficiaries with the level of practical abilities acquired within the study programs, necessary for the exercising the profession of a doctor / pharmacist; 3. The degree of satisfaction of the beneficiaries with the level of communication abilities acquired within the study programs, necessary for the exercising the profession of a doctor / pharmacist; 4. The degree of satisfaction of the beneficiaries with the optional disciplines; 5. The degree of satisfaction of the beneficiaries with the communication between students and didactic staff; 6. Students’ involvement rate in scientific research; 7. Number of academic mobilities of students and didactic staff with universities from Europe; 8. Rate of graduates of the integrated medical and pharmaceutical education, involved in post-university studies through residency and master studies; 9. Rate of graduates of post-university studies in medical and pharmaceutical education, employed in the Health System of the Republic of Moldova; 10. Rate of international graduates of the integrated medical and pharmaceutical education, employed in foreign medical institutions; 11. Degree of satisfaction of public medical-sanitary institutions from the Republic of Moldova with the training level of doctors and pharmacists who graduated from the SUMP ”Nicolae Testemiţanu”

SWOT Analysis of the existing study programs in SUMP “Nicolae Testemiţanu” STRENGTHS 1. Tendency of the educational supply to comply with the requirements of the WHO requirements, provisions of the Bologna Process, necessities of the health system. 2. Didactic process offered in languages of high international use. 3. Existence and functioning of the Curricular Reform Commission, constant Updating of the contents of the study programs through their adaptation to European requirements 4. SNCS implementation through the legal system 5. Facilitation of student mobility through the implementation of the System of Transferable Credits 6. High qualification of didactic staff provides for the formation of professional competences of graduates, which are necessary for a successful exercising of their profession. 7. Existence of a series of policies and possibilities of encouraging the use of modern teaching / learning / testing technologies 8. Early contact with the clinical disciplines (Primary medical emergency; Clinical internship – clinical contents over the course of the pre-clinical cycle) 9. Diversification of optional courses for the years IV–VI 10. Presence of a series of subjects in the curricula of the preclinical years, which help the student to understand the principles of scientific research: Biostatistics. Methodology of scientific research 11. The advantage of the direct contact with the patients from the clinics, which a feature of the Moldovan medical

From Self-Assessment to External Quality Assurance

WEAKNESSES 1. A far greater number of hours compared with universities from the European community 2. The orientation of the teaching methods is a predominantly classic one, hence the need for a greater adaptability to modern methods with proven results. 3. Insufficient vertical integration of fundamental knowledge provided by the biomedical sciences with the practical abilities from the second cycle. 4. Students facing difficulties understanding knowledge in fundamental chemical, biological processes, as a result of a poor level of basic high school knowledge. 5. Small number of students involved in research activities. 6. Quality difference between diploma works and a lack of a specialized software, able to check the originality of students’ works 7. Departments are insufficiently equipped with laboratory apparatus and consumables, necessary to the didactic process 8. Clinical departments are lacking modern medical equipment

42

education. 12. Student involvement in the activity of student scientific classes, participation at national and international conferences with the presentation of the results of their research; 13. Provision by the curricula of crediting of the diploma thesis, which is presented in an organized framework as a test within the State graduation exam. 14. Using clinical guides and protocols within the educational process 15. Introduction of acquiring practical skills through simulation in Training and Testing Centers OPPORTUNITIES 1. Market dynamics imposes a permanent updating of the educational supply. 2. Extended possibilities for harmonization with study programs with European requirements in the training fields which are regulated on a sector basis. 3. Reorganization of the educational process through the implementation of simulation education 4. Diversification of optional and facultative courses 5. Optimization of the methodology of choosing and subscribing to optional courses, which starting the next year will be done online, after the creation of a special software 6. Extension of student mobility abroad. 7. Development of international projects in partnership with European universities. Permanent stimulation of participation at national and international projects aiming at financing didactic activity 8. Implementation of the integrated informational system and its subsequent use for an efficient and transparent communication within the entire educational process.

THREATS 1. Imperfect legislation, existence of gaps and legal stipulations which contradict each other. 2. The danger of insufficient financial resources necessary for the maintenance of an adequate material basis. 3. Seclusion in old curricular paradigms. 4. Resistance to a change in didactic staff. 5. A constant growth in the number of students can negatively affect the quality of the educational process. 6. Migration of didactic staff to other fields of activity

Ex Ante Evaluation Report (RO) Scopul curriculei actuale a USMF ”Nicolae Testemiţanu” este educaţia medicală generală prin promovarea unui set de cunoştinţe, abilităţi practice şi atitudini care să contribuie la formarea medicilor și farmaciștilor competenţi, cu calităţi umane şi de comunicare îndifirent de specialitatea pe care îşi vor alege. În prezent curricula Facultăţilor universităţii este clasică, liniară, bazată pe discipline. Planul de învăţământ cuprinde discipline fundamentale, discipline de specialitate şi socio–umanistice, care sunt structurate în discipline obligatorii şi opţionale. Studiile cuprind cursuri teoretice, seminare şi lucrări practice, stagii clinice, cursuri opţionale şi teza de diplomă, ca componentă a Examenului de Stat de Absolvire. Programul de învăţământ este structurat pe 2 cicluri: preclinic (anii I–III) și clinic (anii IV–VI). Studenţii care nu promovează integral 60 credite ECTS la sfârşitul fiecărui an de studii nu este promovat în următorul an. În scopul realizării reformei curriculare, în temeiul Strategiei de dezvoltare a Universităţii, propunerile experţilor externi şi necesităţile de adaptare a curriculei universitare către standardele învăţământului superior medical european, prin ordinul Rectorului, s–au format Comisiile Curriculare a Facultăţilor Medicină, Stomatologie și Farmacie pentru elaborarea noului plan de învăţământ la specialităţile vizate. S–a elaborat caietul de sarcini, privind activitatea Comisiilor Curriculare. În funcţie de profiluri (medicină înternă, chirurgie, medicină comunitară, ştiinţe fundamentale, farmaceutice, medicină dentară etc.) s–au format mai multe subcomisii. În componenţa subcomisiilor, au fost incluse cadre didactice cu experienţă (profesori universitari, șefi catedră, conferenţiari), cadre didactice tinere (conferenţiari, asistenţi), studenţi, rezidenţi absolvenţi ai USMF ”Nicolae Testemiţanu”, medici și farmaciști practicieni, care activează în sistemul Ocroditii Sănătăţii din Republica Moldova.

From Self-Assessment to External Quality Assurance

43

Astfel au fost analizate programele analitice la fiecare disciplină, pentru identificarea şi excluderea materialului şi surselor bibliografice depăşite; s–au apreciat utilităţile tehnicilor de laborator la disciplinile preclinice şi manoperilor practice existente la cele clinice; s–a minimalizat repetarea în aceeaşi formă a aceluiaşi material; s–au unificat definiţiile, clasificările şi competenţele practice la nivel interdisciplinar. Coordonatorii subcomisiilor au prezentat Comisiei Curriculare propunerile de reformă a curiculei pe disciplini, module. Ţînând cont de aceste propuneri, de recomandările experţilor cât şi analizând curiculele facultăţilor de Medicină partenere: „Victor Babeş”– Timişoara; „Iuliu Haţieganu” – Cluj Napoca; „Gr. T. Popa”– Iaşi; Univerșite D'Angers – Franţa; Scool of Medical Sciences UMC Utrecht, Biroul Decanatelor facultăţilor în comun acord cu şefii disciplinelor au făcut o reevaluare a curiculei şi o primă adaptare, elaborând în 2011 noul Plan de Învăţământ. Menţionăm, că în Planul de învăţământ actual, am ţînut cont şi de cuantumul de ore destinate disciplinelor, cât şi de plasamentul lor prin analiza comparativă cu planurile de învăţământ din UE, pentru a facilita o ulterioară mobilitate academică. În cadrul elaborării curriculei Comisiile s-au condus de următoarele acte normative în vigoare: 1. Criteriile WFME (World Federation for Medical Education) de organizare a învăţământului medical superior. 2. Directiva 2005/36/CE a Parlamentului European și a Consiliului din 7 septembrie 2005 privind recunoașterea calificărilor profesionale. 3. Legea învăţământului, Nr. 547 din 21.07.1995. 4. Legea privind aprobarea Nomenclatorului domeniilor de formare profesională şi specialităţilor pentru pregătirea cadrelor în instituţiile de învăţământ superior, ciclul I, nr. 142 din 07.07.2005. 5. Legea privind aprobarea Regulamentului de evaluare şi acreditare a instituţiilor de învăţământ, Nr. 423 din 04.06.1999. 6. Regulamentul de organizare a studiilor în învăţământul superior în baza Sistemului Naţional de Credite de Studiu, Ordinul Ministerului Educaţiei nr. 726 din 20.09.2010. 7. Regulament – cadru al catedrei instituţiei de învăţământ superior, Ordinul nr. 671 din 06.08.2010. 8. Regulamentului cu privire la instruirea străinilor în instituţiile de învăţământ din Republica Moldova, Aprobat prin Hotărârea Guvernului Republicii Moldova Nr. 746 din 21.06.2003. 9. Carta Instituţiei Publice Universitatea de Stat de Medicină şi Farmacie „Nicolae Testemiţanu" din Republica Moldova cu modificările şi completările ulterioare. 10. Ghidul de implementare a SNCS 11. Plan-cadru pentru ciclul I de studii (studii superioare de licenţă). Ulterior, Comisiile curriculare ale facultăţilor au prezentat Consiliilor facultăţilor programele de studii prezentate sub forma unui pachet de documente care înclud: ∙ obiectivele generale şi specifice ale programului; ∙ planul de învăţământ cu ponderile disciplinelor exprimate prin credite de studiu SNCS şi cu disciplinele ordonate succesiv în timpul de școlarizare; ∙ programele tematice sau fişele disciplinelor încluse în planul de învăţământ. După aprobarea programelor de studii la facultăţi a urmat aprobarea acestora la Senatul USMF ”Nicolae Testemișanu”, Ministerul Sănătăţii și Ministerul Educaţiei Republicii Moldova.

Descrierea distribuirii responsabilităţilor în procesul elaborării și monitorizării dosarelor pentru aprobarea instituţională În cadrul elaborării noilor programe de studii responsabilităţile au fost divizate după cum urmează: 1. Șefii subcomisiilor curriculare – Revizuirea materialului factologic pe disciplini de studii, integrarea disciplinelor pe orizontală și verticală. 2. Șefii Comisiilor curriculare pe facultăţi – Integrarea datelor parvenite din subcomisii, optimizarea numărului de ore, propunerea disciplinelor noi obligatorii și opţionale pentru: familiarizarea studenţilor cu istoricul învăţământului superior medical și farmaceutic; tehnicilor de învăţământ şi bazele culturii informaţionale; metodologia cercetărilor știinţifice, asigurarea contactului precoce cu pacienţii, optimizarea stagiului clinic. 3. Biroul facultăţilor (Decanii și vicedecanii) – Elaborarea programelor noi de studii în baza propunerilor Comisiilor curriculare, armonizate cu cerinţele actelor normative naţionale, asigurarea suportului logistic în activităţile comisiilor și subcomisiilor, introducerea disciplinelor noi obligatorii și opţionale, introducerea tezelor de diplomă

From Self-Assessment to External Quality Assurance

44

drept element obligatoriu al Examenelor de Stat, optimizarea stagiului clinic, introducerea stagiului practic de Stat pentru studenţii facultăţii Farmacie. 4. Secţia didactică - asigurarea suportului logistic și consultativ în activităţile comisiilor și subcomisiilor curriculare, armonizarea programelor noi de studii, integrarea interfacultativă a programelor noi de studii la nivel de universitate. 5. Prorector pentru Asigurarea calităţii și integrării în învăţământ – monitorizarea activităţii comisiilor și subcomisiilor curriculare, biroului facultăţilor, secţiei didactice.

Indicatori care vor putea fi ușor înţeleși și administraţi de către promotorii (Facultate / Departament) noilor programe de studiu 1. Gradul de satisfacţie a beneficiarilor (studenţilor) de calitatea învăţământului medical și farmaceutic ofeit; 2. Gradul de satisfacţie a beneficiarilor de nivelul abilităţilor practice achiziţionate în cadrul programului de studii necesare exercitării profesiei de medic/farmacist; 3. Gradul de satisfacţie a beneficiarilor de nivelul abilităţilor de comunicare achiziţionate în cadrul programului de studii necesare exercitării profesiei de medic/farmacist; 4. Gradul de satisfacţie a beneficiarilor de oferta de discipline opţionale; 5. Gradul de satisfacţie a beneficiarilor de comunicarea dintre studenţi și cadre didactice; 6. Rata de antrenare în cercetarea știinţifică a studenţilor; 7. Numărul de mobilităţi academice ale studenţilor și cadrelor didactice cu universităţile din Europa; 8. Rata absolvenţilor învăţământului integrat medical și farmaceutic antrenaţi la studii postuniversitare prin rezidenţiat și masterat; 9. Rata absolvenţilor studiilor postuniversitare în învăţământul medical și farmaceutic angajaţi în sistemul Ocrotirii Sănătăţii din Republica Moldova; 10. Rata absolvenţilor internaţionali ai învăţământului integrat medical și farmaceutic angajaţi în instituţiile medicale de peste hotare; 11. Gradul de satisfacţie a instituţiilor medico-sanitare publice din Republica Moldova de nivelul pregătirii medicilor și farmaciștilor absolvenţi ai USMF ”Nicolae Testemiţanu”

Analiza SWOT a programelor de studii existente în USMF ”Nicolae Testemiţanu” PUNCTE TARI 1. Tendinţa de conformare a ofertei educaţionale la cerinţele OMS, prevederile Procesului de la Bologna, necesităţile sistemului de sănătate. 2. Proces didactic oferit în limbile de circulaţie internaţională. 3. Existenţa şi funcţionalitatea Comisiei de Reformă Curriculară Actualizarea permanentă a conţinutului programelor de studiu la disciplinele prin adaptarea acestora la cerinţele europene 4. Implementarea prin lege a SNCS 5. Facilitarea mobilităţilor studenţeşti prin aplicarea Sistemului de Credite Transferabile 6. Înalta calificare a cadrelor didactice asigură formarea unor competenţe profesionale ale absolvenţilor necesare în desfăşurarea cu succes a profesiei. 7. Existenţa unor politici şi posibilităţi de încurajare a utilizării tehnologiilor moderne de predare / învăţare / testare 8. Contactul precoce cu disciplinele clinice (Urgenţa medicală primară; Stagiu clinic – conţinut clinic în cursul ciclului preclinic) 9. Diversificarea cursurilor opţionale la anii IV–VI 10. Prezenţa în curriculă în anii preclinici a unor materii care ajută studentul la înţelegerea principiilor cercetării ştiinţifice: Biostatistica. Metodologia cercetării ştiinţifice 11. Avantajul contactului direct cu pacienţii din clinici, care

From Self-Assessment to External Quality Assurance

PUNCTE SLABE 1. Numărul de ore mult mai mare comparativ cu universităţile din comunitatea europeană 2. Orientarea metodelor de predare este predominant clasică, fiind necesară o mai mare adaptabilitate la metodele moderne şi cu rezultate dovedite. 3. Integrarea insuficientă pe verticală a cunoştinţelor fundamentale furnizate de ştiinţele biomedicale cu cunoştinţele şi abilităţile practice din al doilea ciclu. 4. Dificultăţi de înţelegere de către studenţi a cunoştinţelor în procesele chimice, biologice, fundamentale legate de nivelul slab de cunoştinţe de bază din liceu. 5. Numărul scăzut de studenţi implicaţi în activităţi de cercetare. 6. Diferenţa de calitate între lucrările de diplomă şi inexistenţa unui soft specializat care să verifice originalitatea lucrărilor studenţilor 7. Dotarea insuficientă a catedrelor cu utilaj de laborator şi consumabile necesare procesului didactic 8. Dotarea insuficientă a bazelor clinice cu utilaj

45

caracterizează învăţământul medical din Moldova. 12. Implicarea studenţilor în activitatea cercurilor ştiinţifice studenţeşti, participarea la conferinţe naţionale şi internaţionale cu prezentarea rezultatelor cercetării; 13. Existenţa în curriculă a creditării pregătirii tezei de diplomă; aceasta se prezintă în cadru organizat, ca probă în cadrul examenului de Stat de absolvire. 14. Utilizarea ghidurilor şi protocoalelor clinice în procesul educaţional 15. Introducerea pregătirii în Centrul de instruire şi testare a deprinderilor practice prin simulare OPORTUNITĂȚI 1. Dinamica pieţei muncii impune o actualizare permanentă a ofertei educaţionale. 2. Posibilităţi extinse de armonizare a programelor de studiu cu cerinţele europene în domeniul de formare reglementat sectorial. 3. Reorganizarea procesului educaţional prin implementarea învăţământului prin simulare 4. Diversificarea ofertei de cursuri opţionale și facultative 5. Optimizarea metodologiei de alegere şi înscriere la cursurile opţionale, care din anul viitor se va face on–line, după construcţia unui program dedicat acestui scop 6. Extinderea mobilităţilor studenţeşti, în străinătate. 7. Dezvoltarea de proiecte internaţionale în parteneriat cu universităţile europene. Stimularea permanentă a participării la proiecte naţionale şi internaţionale în vederea finanţării activităţii didactice 8. Implementarea sistemului informaţional integrat, utilizarea lui pentru comunicare eficientă şi transparentă în tot procesul educaţional.

medical performant

AMENÎNȚĂRI 1. Legislaţie imperfectă, existenţa lacunelor şi a prevederilor legale care vin în contradicţie. 2. Pericolul insuficienţei resurselor financiare necesare întreţinerii unei baze materiale adecvate. 3. Închistarea în vechile paradigme curriculare. 4. Rezistenţa la schimbare a cadrelor didactice. 5. Creşterea constantă a numărului de studenţi poate afecta calitatea actului educaţional. 6. Migrarea cadrelor didactice în alte domenii de activitate

Tiraspol State University Ex Ante Evaluation Presentation (EN) LARISA SALI

Teaching Staff 15 Professors, 82 PhD, 79 Lecturers, 42 PhD students

Faculties ∙ ∙ ∙ ∙ ∙

Biology and Chemistry Physics, Mathematics and IT Geography Philology Pedagogy

1st cycle 13 specializations in Science and Humanities 29 Specializations in Science and Education

2nd cycle 1. Educational sciences (10):

From Self-Assessment to External Quality Assurance

Modern mathematics and modern educational technology Modern physics and modern formative technology IT in educational processes Pedagogy and methodology at the primary education level Psycho-pedagogy of school education Geography in educational system Educational management Preschool education management Contemporary Romanian/Russian language and literature and IT Biology and educational technologies 2. Natural Sciences (4): Applied biology Environmental Geography and Economic Geography Contemporary Chemistry Ecological Chemistry 46

Geography and IT 3. Public services Strategic Management in Tourism

3rd cycle Geometry and Topology Mathematical Logic, Algebra and Number Theory Mathematical Analysis Differential Equations

Strategic research directions ∙ Consolidation of the State of the Law and the use of cultural heritage in the perspective of integration into the multicultural and multinational Europe. ∙ Economic basis of sustainable development and efficient use of human and natural resources. ∙ Nanotechnology, new materials and information technology

Condensed State Physics Botany Physical Geography, Geophysics and Geochemistry of Landscapes Protection of Environment and Reasonable Use of Natural Resources General Pedagogy Theory and Methodology of Teaching

Scientific accredited fields ∙ Regional study on geographical and biological systems ∙ Concepts and strategies of modernizing the educational process ∙ Current problems of mathematical and physicochemical sciences

How a new study program is currently approved at TSU ∙ ∙ ∙ ∙ ∙ ∙ ∙ ∙ ∙

A special Working Group elaborates the drafts of the study program; Heads of Departments propose to discuss the draft at the meeting of all members; The departmental meeting approves and submits the program to the Faculty Methodological Commission; The Faculty Methodological Commission examines and appreciates the quality of the projects. The Faculty Methodological Commission decides to submit the draft at the meeting of the Faculty Council or return it for improvements. The Faculty Council examines and assesses the quality of the project and submits it for consideration as appropriate TSU Methodological Commission. The TSU Methodological Commission reviews and appreciates the quality of the submitted projects, stating the objections and suggestions of experts. TSU Methodological Commission decides about submission of the project to Senate examination. The Senate approves the TSU Methodological Commission decision and submits the curriculum of the specialty to the Ministry of Education to be confirmed.

Distribution of responsibilities in formulating and monitoring records for institutional approval ∙ ∙ ∙ ∙ ∙ ∙

The working groups consisting of chairs; Heads of departments who submit the draft program; Heads of the Faculty Methodical Commissions; Deans of faculties; The TSU Methodical Commission; The Vice-rector responsible for educational process and quality assurance

List of relevant information that should be considered in the process of program development ∙ ∙ ∙ ∙ ∙ ∙

Council Regulation department Council Regulation faculty TSU internal Regulation on the Quality Management System Framework Plan for higher education National Qualifications Framework The Rules of organization of higher education studies in the Credit Study National System

From Self-Assessment to External Quality Assurance

47

Objectives of QMS at TSU ∙ Delineation of duties and responsibilities at different levels of the organizational structure ∙ Establishing limits of competence at each level of the hierarchy ∙ Establishment of the University's existing structures and newly created structure QMS

Quality of education and research in TSU is determined by ∙ teaching quality, depending on: the quality of teaching staff, the quality of graduate students and the quality of curricula in the areas of training specialists ∙ research quality : the competences of researchers, quality of available resources, the quality of research output, the beneficiaries’ trust ∙ customer services quality: quality of material and technical resources (educational space, equipment), quality of library services, quality of social, cultural, sports, and living conditions etc.., availability of financial resources

Strengths of TSU in developing a new program ∙ Study programs are developed in accordance to the legislation in force; ∙ Curriculum structure meets the methodological requirements of the discipline curriculum theory and focuses on skills training; ∙ The educational staff have scientific and didactical titles / degrees, their academic and professional qualifications are adequate; ∙ Scientific research is part of the operational plans and strategic development of the departments; ∙ In developing the program, we take into account how much students are interested in this program and the needs of the labor market

The Improvement of the Process of Drafting and Approval of a New Program of Study at TSU ∙ ∙ ∙ ∙

Introduction of double specialties for the second cycle of specialists training in educational sciences; Consideration of labor market demands; Possibilities of promoting practical activities in specialized institutions; Opportunities to pursue individual self-regulated learning activities through cooperation and partnership between students who have different bachelor qualifications

Alecu Russo Balti State University Ex Ante Evaluation Presentation (EN) VALENTINA PRITCAN, VICE-RECTOR FOR RESEARCH AND INTERNATIONAL RELATIONS

Context Orienting the strategy of developing higher education in the Republic of Moldova to European Standards, which found an explicit embodiment in the objectives of the Bologna Process, determined the need for an essential reform of university curricula at the level of both content and structure. In such a way the development and approval of the new study programmes or redesign of the existent ones is considered a key procedure for BSU.

What study programmes have been recently developed or redesigned? ∙ ,,Engineering and Management (in vehicles)” (BA), developed in cooperation with the German Company ,,Draxlmaier Automotive” Ltd; ∙ ,,Labor and Human Resource management relation”, (MA), developed in cooperation with the Private Law Department, representatives of the Law institutions and economic units; ∙ Updating the study programmes for specialties ,,ICT in educational system” and ,,Primary Education” with the technical and logistical support of the Tempus project -Teacher Education Review and Update of Curriculum (TEREC). From Self-Assessment to External Quality Assurance

48

First aspects to analyze before developing a new study programme ∙ ∙ ∙ ∙ ∙

Is it required on the labor market? What are the modern trends in the economy, culture and education? Is the profile department, teaching staff enough qualified to train the specialists? Does the University dispose of resources, material assets necessary to facilitate the training of specialists? Is there a similar study programme developed at other universities in the country or abroad? What are the modern trends in the economy, culture and education, to adapt curricula to the requirements of a modern specialist? ∙ Is the library enough ensured with scientific resources?

The trajectory of approving a new study programme ∙ The study programme is discussed at the meeting of the department involved; ∙ The study programme is discussed at the meeting of the Faculty Council; ∙ The study programme is pre-approved by the academic Committee of the University Senate and by the Quality Management Department; ∙ The study programme is approved by the University Senate; ∙ The study programme is coordinated with cu Ministry of Education of the Republic of Moldova.

The structure of the dossier/portfolio ∙ ∙ ∙ ∙ ∙

The study programme, developed according to the requirements of the framework; The explicative note of the study programme; The curricula of the course units included in the study programme; The list of the course units and teaching staff that lectures these course units; The informative table regarding the extension of covering the courses and resources (textbooks, course notes, electronic course on the learning platform)

References ∙ The Law on Education Nr. 547-XIII from July 21st, 1995; ∙ The Law Nr.142-XYI from July 7th, 2005, on the approval of the list of training areas and specialties for teaching in institutions of higher education, first cycle; Framework Plans for higher education (first cycle Bachelor’s degree, and second cycle Master’s degree); ∙ ECTS User Guide; ∙ The Guide on implementation of the national System of Study Credits, approved by the Minister of Education, Youth and Sports Nr. 140 from February 25th, 2006; ∙ Work instruction of the al QMS of Alecu Russo Balti State University ,,Explicative Note to the Study Plan”; ∙ Design of the training in higher education. Guide for academic staff, author – V. Vabac, Balti, 2012

Top 10 indicators that could be easily used and administered by the promoters of new programs (at Faculty/Department level) 1.

Code indicators B 1.1.

2.

B 3.1.

3.

B 5.2.

4.

B 4.1.

5.

B 5.3.

N/o

Decoding The studies Program is authorized and activates according to the normative acts in force The contents of the studies Program is oriented towards competencies formation Curriculum structure for the disciplines corresponds to the methodological provisions of the curricular theory The contents of the education plan are in harmony with the mission and objectives of the Program Taxonomic projection and timing of the realization of objectives is oriented towards intertwined formation of knowledge, abilities and attitudes

From Self-Assessment to External Quality Assurance

N of points (out of 10) 6 6 5 5 5

49

6.

B 6.3.

7.

B 7.1.

8.

B 7.2.

9.

B 7.8.

Curricular support is available to students (as a number, as a way of utilization) The studies Program is realized according to the Regulation on the education organization The specialty faculty / chair activates according to the strategic and operational plans The documentation of the chair / faculty corresponds to the register of the documents necessary for the realization of the studies Program

5 5 5 5

Top 10 Main Indicators from the perspective of new programmes promoters N/o 1. 2. 3. 4. 5. 6. 7. 8. 9. 10.

Code indicators B 1.2. B 10.4. C 1.5. D 5.2. A 2.1. A 4.4. A 5.5. B 1.1. B 5.5. B 6.1.

Decoding The curriculum meets the National Qualifications Framework The tests are designed correctly and meet the inherent characteristics of an assessing tool Calificarea profesională a cadrelor didactice corespunde cerinţelor domeniului de formare profesională iniţială în care sunt implicate Professional qualifications of teachers meet the requirements for initial training in the field The strategic development program of the HEI is geared towards the educational policies of the state and labor market needs The management system of the institution has effective ways of transmitting information and receiving feedback The institutional management stipulations provide academic staff mobility The curriculum is approved and works according to laws in force The didactic strategies are oriented towards students’ active learning The study programmes are ensured with the curricular support and adequate lab equipment in order to achieve the planned skills (generic and specific)

N of points (out of 10) 4 4 4 4 3 3 3 3 3 3

Information / documentation and consulting services that can be provided by the department of QM in the process of developing a new study programme ∙ A didactic guide for designing the training in University; ∙ Criteria, indicators and assessment procedures of the study programmes, updated according to the TUNING project recommendations; ∙ information about the need of specialists in the field for labor market; ∙ the list of database for internship placement, describing subsidies and their availability for the calendar periods; ∙ the results of students' survey on teaching strategies used by teachers, who probably will support the teaching programme; ∙ unified demands on the curriculum of the subjects / modules (standard items); ∙ facilitating the publication of curricular supports, including financial support; ∙ disseminating the results of monitoring employment of graduates in the labor market; ∙ suggestions on improving the quality of education; ∙ contributing to the development of quality culture in the university; ∙ providing information on labor market application of the specialists who will be trained in the new curriculum of study; ∙ the ongoing advice throughout the elaboration of the dossier for the new study programme (regulations, dossier contents etc.). ∙ internal evaluation of the study programme dossier before presenting it to the responsible Committee of the faculty; ∙ advisory services in the external evaluation; ∙ information on world experience of developing and evaluating curricula

From Self-Assessment to External Quality Assurance

50

Strong points of USB in the process of developing a new study programme ∙ there exists some experience in developing a new study programme based on the recommendations of the Tuning project and the European Qualifications Framework; ∙ flexible teaching staff, open to ongoing trainings; ∙ identifying the labor market needs; ∙ the strategic development plan of the university is geared towards developing and implementing new study programmes; ∙ the Scientific Library of the university is one of the best equipped in the country

Areas identified for improvement in the development and approval of a new study programme at USARB ∙ during the Tempus project TEREC (Teacher Education Review And Update Of Curriculum), in which the faculty of Exact Science and the Faculty for Education Science and Arts participated, had experienced a process of drafting and approving a new study programme, which corresponds to the recommendations of a former Tempus project TUNING; ∙ the making process starts with designing a basic document: the profile of the specialization, which serves as the starting point for the study programme. The new thing about it is that the profile now contains a list of skills to be developed within the study programme and training outcomes list (as opposed to formulating objectives); ∙ based on the specialty profile, the study programme is developed, taking into account the provisions of the framework for higher education; ∙ for each unit, to be included in the programme, a short document is developed: the description of the course unit; ∙ based on the description of the course unit, a plan is being developed. Unlike the curriculum of the discipline, the course unit plan contains the technological map of the course unit, which describes all learning activities of students (those performed as a direct contact with the teacher and independent work). It allows to manage and evaluate the learning activity

New Experience ∙ Study programme ,,Engineering and Management (in vehicles)”, (BA), in cooperation with the German Company ,,Draxlmaier Automotive” Ltd; ∙ Cooperation with the Ministry of Education, industry, experts from Germany; ∙ Implication of the representatives from the industry and relevant experts in all the developing stages of the study programme; ∙ Continuous education support from DAAD

Ex Ante Evaluation Report (EN) Argument In 1944, the current territory of the Republic of Moldova became a part of the Soviet Union, a socialist country, with a centralized economy. In 1991, with the disintegration of the USSR, the Republic of Moldova becomes an independent state and starts a long and sinuous journey towards market economy, while facing increased demographic and labor force outflows along the way. Before 1989, the training of specialists with higher education used to be commissioned by the state and according to the study programs, which were centrally elaborated, while the graduation from education institutions was followed by immediate employment. Once the transition to market economy had started and production collapsed following the declaration of independence, employment of fresh graduates changed dramatically. At the same time, the elaboration of curricula has become a top priority for universities. The re-orientation of the development strategy of higher education in the Republic of Moldova towards European standards, which came into being in the shape of the Bologna Process, has uncovered the need for an essential reform of the university curricula on the content and structural levels. Thus, the elaboration and approval of new study

From Self-Assessment to External Quality Assurance

51

programs or the substantial amendment of the existing ones, are regarded as a key procedure for the State University “Alecu Russo” from Bălţi. Among the most recently elaborated / modified programs, we would like to mention: “Engineering and management (in auto transport)”, level I, higher bachelor studies, elaborated jointly with the German company “Draexlmaier Automotive”; “Work relationships and management of human resources”, level II, higher master studies, elaborated jointly with the Private Law Chair, representatives of legal institutions and economic agents; modernization of study programs for the specialties “ICT in education”, “Primary education” with the technical and logistical support of the Tempus Project – Teacher Education Review and Update of Curriculum (TEREC ) ş.a.

Brief description of the manner in which a new study program is currently approved at the university The elaboration of a study program requires a prior analysis of the following aspects: ∙ Is there demand for the new program on the labor market? What are the current trends in economy, culture and education? ∙ Does the Chair / University have the qualified human resources which will ensure the specialists’ training? ∙ Does the University have the resources, material basis which are necessary for the specialists’ training? ∙ Is there a similar study program in other universities from Moldova and from abroad? ∙ What are the modern tendencies in economy, culture and education that a study program has to be adapted to in order to correspond to the requirements a modern specialist faces? ∙ Does the scientific Library have enough resources? Afterwards, a work group is created, consisting from the members of the profile chair, managers, and representatives of the labor market. The study program elaborated by the work group is then discussed and approved. During the elaboration of the study program, the work group takes the following references into consideration: ∙ Law on education nr. 547-XIII from July 21st 1995; ∙ Law nr.142-XYI from July 7th 2005 regarding the approval of the Classification of professional formation fields and specialties for the training of personnel in higher education institutions, cycle I; ∙ Framework-plans for higher education (cycle I – higher bachelor studies, cycle II- higher master studies); ∙ ECTS user guide; ∙ Guide for the implementation of the National System of Study Credits, approved by the order of the Ministry of Education, youth and sports nr. 140 from 25.02.06; ∙ Work instructions of the SMC USARB “Explanatory note for the education plan”; ∙ Projecting formation in university education. Guide for the university didactic staff, author – V. Vabac, Bălţi, 2012 The sequence of events in approving a new study program at the State University “Alecu Russo” from Bălţi is the following: ∙ The study program is discussed at the session of the profile chair; ∙ The program is discussed at the session of the faculty Council; ∙ The program is endorsed by the academic Commission of the university Senate and y the Department for Quality Management; ∙ The program is approved by the university Senate; ∙ The program is coordinated with the Ministry of Education of the Republic of Moldova. The intention of opening a new study program needs a prior coordination with the Ministry of Education of the Republic of Moldova in order to be approved. The structure of the file / portfolio of the study program: ∙ The study program, elaborated according to the requirements of the framework-plan; ∙ Explanatory note for the education plan; ∙ Disciplinary curricula of the course units included in the program; ∙ List of course units and didactic staff who perform the courses; ∙ Informative table regarding the degree to which the courses are supplied with resources (manuals, lecture notes, elearning course platform).

From Self-Assessment to External Quality Assurance

52

Distribution of responsibilities in elaborating and monitoring the files for the institutional approval comprises the following network: work group for the elaboration of the study program – profile chair – Faculty Council – academic Commission of the university Senate and the Department for Quality Management – university Senate. One of the best practices of the State University “Alecu Russo” from Bălţi is represented by the experience of the social partnership and the collaboration with the labor market. Who came up with the initiative to open a study program at the State University “Alecu Russo” from Bălţi? The diversification of the educational supply and its adjustment to the requirements of the labor market is realized through: ∙ technical and logistical support from European structures owing to the initiatives of the university staff and / or representatives of other universities: opening the specialty “Social Assistance” through the project of the Tempus Program T_JEP-10012-1995 (MD) ARUB: Studiengang Sozialwesen, March 1995 – March 1998; development of professionalized courses aiming at improving the adaptability of economics specialists on the labor market and issuing double diplomas, with the University Clermont-Ferrand, France within the project “Modernization and development of professional courses” Nr: 144920-TEMPUS-2008-FR-JPCR; elaboration of the study program for the training of the teachers of Romanian language and literature though the project “P159338-TEMPUS-1-2009-1-LVTEMPUS-SMHES “Development of the higher education system through the improvement of the social partnership (Faculty of Philology); ∙ the initiative of industry representatives. Hence, in 2001-2002 the Institute for Field Crops Research from mun. Bălţi, which had virtually no young specialists, most of them being of retirement age, has decided to train future specialists for the respective institution. Two new study programs have been opened at the University - “Agroecology” and “Agronomy”. The study programs took into consideration the peculiarities of the specialists’ training for the Institute of Field Crops Research “Selecţia” from mun. Bălţi. Between 50% and 55% of the study disciplines are currently promoted by this institution’s personnel. All types of practical work and most of the laboratory works are performed at the laboratories and on the premises of the Institute for Field Crops Research “Selecţia” from mun. Bălţi. In a few years, the personnel of this institution have become truly competitive, having young new employees. They already have a few disciples who are currently doing doctoral studies; ∙ initiative of the profile chair, managers and / or employees. The adherence of the Republic of Moldova to the Bologna Process in 2005 has diversified the study programs at those three levels of training of the specialists with higher education: bachelor, master and doctoral studies. The managers of university subdivisions have studied the requirements of the market and have proposed new specialties and specializations; ∙ specification by the Government of the priority fields of training of the specialists with higher education (according to the Classification of Professions); ∙ requests/inquiries originated through the feedback we receive from students after the internships they perform in various institutions and organizations and the initiatives and proposals they come up with during internship conclusion conferences; ∙ suggestions received from students during the current and final evaluations. By the end of each semester the Department for Quality Management analyzes students’ reflections on the process of professional formation and requests improvement suggestions. Additionally, upon faculty graduation, all students fill in an on-line survey which contains comprehensive information about their professional formation experience in the University. Afterwards, the results of the opinion surveys are quantitatively and qualitatively analyzed and presented to the academic community. These results are taken into consideration during the development of policies of modernization of professional preparation curricula; ∙ analysis of the opinions of beneficiaries of recycling and / or continuous formation courses provided by the University, which represent the country’s labor force. Example In 2011 the German firm “Draexlmaier Automotive” SRL, registered in the free economic zone Bălţi, having realized that there is an acute shortage of mid-level managers (heads of divisions, shifts) has addressed the management of the State University “Alecu Russo” from Bălţi with the proposal to train specialists in engineering and auto transport management. After a few months’ worth of work, the study program for the specialty “Engineering and management” (in auto transport) has been elaborated jointly with the specialists from a series of universities from Germany and industry representatives, who especially appreciate the practical training of young specialists. A series of courses are

From Self-Assessment to External Quality Assurance

53

promoted by a group of didactic personnel from German universities. The representatives of “Draexlmaier Automotive” SRL have participated at all stages of the process – negotiating with the Government representatives the initiative to open the study program at the Bălţi University, elaboration of the study plan, selection of experts, the process of teaching-learning-evaluation, organizing internships etc.. the exception contribution of “Draxlmaier Automotive” SRL is represented by its investment in human resources – the support of the project amounting to 15.000 Euro, financed by DAAD is currently ensuring the continuous formation of the Bălţi university staff, who teach within this specialty.

Results of the Interview The interview has been realized at various levels (pro-rectors, deans, heads of departments, relevant didactic staff). 10 persons have been interviewed – see annex N 1. The interview has been realized with the goal of enumerating:

a. Indicators which will be easy to understand and manage by promoters (Faculty / Department) of the new study programs. The quantitative results are presented in annex N 2. Table N 1 reflects indicators which will be easy to understand and manage by the promoters (Faculty / Department) of the new study programs from the perspective of the collaborators included in the study. Table N 1: Top 10 Indicators which will be easy to understand and manage by the promoters (Faculty / Department) of the new study programs.

1.

Code indicators B 1.1.

2.

B 3.1.

3.

B 5.2.

4.

B 4.1.

5.

B 5.3.

6.

B 6.3.

7.

B 7.1.

8.

B 7.2.

9.

B 7.8.

N/o

Decoding The studies Program is authorized and activates according to the normative acts in force The contents of the studies Program is oriented towards competencies formation Curriculum structure for the disciplines corresponds to the methodological provisions of the curricular theory The contents of the education plan are in harmony with the mission and objectives of the Program Taxonomic projection and timing of the realization of objectives is oriented towards intertwined formation of knowledge, abilities and attitudes Curricular support is available to students (as a number, as a way of utilization) The studies Program is realized according to the Regulation on the education organization The specialty faculty / chair activates according to the strategic and operational plans The documentation of the chair / faculty corresponds to the register of the documents necessary for the realization of the studies Program

N of points (out of 10) 6 6 5 5 5

5 5 5 5

b. Crucial indicators (from the perspective of the promoters of new programs) The interview participants were asked to name the indicators they consider the most important. Quantitative results are reflected in annex N 3. The frequency of these indicators is reflected in annex N 5, while those with a high frequency are presented in table N 2. Table N 2: Top 10 Crucial Indicators from the perspective of the promoters of new programs.

1.

Code indicators B 1.2.

2.

B 10.4.

3.

C 1.5.

N/o

Decoding The studies Program corresponds to the National Framework of Qualifications The tests applied are correctly elaborated and possess the inherent characteristics of an evaluation instrument The professional qualification of the didactic staff corresponds to the

From Self-Assessment to External Quality Assurance

N of points (out of 10) 4 4 4 54

4.

D 5.2.

requirements of the field of initial professional formation in which they are involved The competitiveness of the Program’s graduates on the labor market

4

It has been emphasized that an important new direction for the improvement of the quality of specialists’ formation is the computerization / internetization of the formation process. This is the reason why special importance is attributed to indicators referring to technical endowment of classrooms, the number of students per computer, internet speed, Wi-Fi services at the university campus, the number of courses on the e-learning platform. [N1]

c. According to the indicators proposed in the guides, what kind of information / documentation or consulting services can be facilitated or provided to the promoters of new programs by the internal unit of Quality Assurance during the elaboration of a new study program? Consulting information / documentation or services expected by the interviewed persons to be provided by the QM during the elaboration of a new study program: ∙ A methodological guide for formation projection in the university; ∙ Criteria, indicators and procedures for the evaluation of study programs, updated according to the recommendations of the Tuning project; ∙ Information about the labor market demand for specialists in the respective field; ∙ List of endowments for practical work, describing equipment and its availability over certain periods; ∙ Results of students’ surveys regarding the didactic strategies used by the professors, who will probably ensure the program’s didactic support; ∙ Unified requirements regarding the Curriculum of the disciplines / modules (standard elements); ∙ Facilitating the publishing of curricular material, including financial support; ∙ Dissemination of the results of monitoring the graduates’ employment; ∙ Suggestions regarding the improvement of the quality of the study process; ∙ Contributing to the development of the quality culture at the university; ∙ Providing information regarding the labor market demand for specialists who will be trained according to the new study program; ∙ Permanent consulting over the entire course of the elaboration of the file for the new study program (normative acts, file contents etc.); ∙ Internal evaluation of the file of the new study program prior to its presentation to the faculty’s methodic commission; ∙ Consulting services during external evaluation; ∙ Information regarding world experience in elaborating and evaluating study plans

d. According to the previous analysis, what are your institution’s strengths in the elaboration of a new program? SUARB strengths in the elaboration of a new program: ∙ There is a certain amount of experience in elaborating a new program according to trhe recommendations of the TUNING program and the European qualifications framework (see p. 4); ∙ Experience in the identification of labor market requirements through collaboration with the industry and the development of social partnerships; ∙ The strategic program for university development is oriented towards the elaboration and implementation of a new study program; ∙ The Scientific Library of the University is one of the most well-endowed libraries in the country; ∙ The didactic staff is flexible and open to formation

e. Have identified any fields of improvement in the elaboration of a new study program in your university? Within the project TEREC (Teacher Education Review and Update of Curriculum), which the faculty of Real Sciences and faculty of Education and Arts participate at, a process of elaboration and approval of a new study program

From Self-Assessment to External Quality Assurance

55

according to the TUNING project has been experimented; the elaboration begins with the conception of a basic document: the profile of the specialty, which serves as a starting point for the elaboration of the study program. A new aspect: the profile of the specialty contains the list of competencies which are to be formed / developed within the study program and the list of expected formation results (as opposed to stating objectives). Based on the specialty profile, the study program is elaborated taking into consideration the provisions of the framework-plan for higher education. For each course unit, included in the program, a short document is elaborated: course unit description. Based on the description the plan of the course unit is elaborated. As opposed to the discipline’s curriculum, the plan of the course unit contains the technological map of the course unit, in which all students’ learning activities are described (those realized by means of a direct contact with the teacher and those realized through independent activity). This provides for a better management and evaluation of the learning activity; The study program “Work relationships and management of human resources”, cycle II, higher master education, elaborated jointly with the chair of Private Law, representatives of legal institutions and economic agents; The studies program for the specialty “Engineering and management” (auto transport) elaborated jointly with the specialists from a series of German universities and representatives of the German company “Draexlmaier Automotive” SRL, registered in the Bălţi Free Economic Zone.

Ex Ante Evaluation Report (RO) Argument Din 1944, actualul teritoriu al Republicii Moldova a fost parte a Uniunii Sovietice, ţară socialistă, cu economie centralizată. În 1991, odată cu destrămarea URSS, Republica Moldova îşi obţine independenţa şi parcurge o cale lungă şi sinuoasă de tranziţie la economia de piaţă, marcată de creşterea nivelului fluxurilor demografice şi a fluxurilor pe piaţa muncii. Până în anul 1989, pregătirea specialiştilor cu studii superioare se realiza în conformitate cu comanda de stat şi programele de studii elaborate centralizat, iar ieşirile din sistemul de învăţământ erau urmate de încadrarea imediată în muncă. Odată cu trecerea la economia de piaţă şi colapsul producţiei care a urmat după obţinerea independenţei, situaţia privind încadrarea în cîmpul muncii s-a schimbat radical, iar elaborarea parcursurilor de studiu a devenit o prioritate a universităţilor. Orientarea strategiei de dezvoltare a învăţământului superior din Republica Moldova spre standardele europene, care şi-au găsit o întruchipare explicită în obiectivele Procesului de la Bologna, a determinat necesitatea efectuării unei reforme esenţiale a curriculei universitare la nivel de conţinut şi structură. Astfel, elaborarea și aprobarea noilor programe de studiu sau modificarea substanţială a celor existente este considerată procedură cheie pentru Universitatea de Stat ,,Alecu Russo” din Bălţi. Printre cele mai recente programe de studii elaborate/modificate menţionăm: ,,Inginerie şi managemen (în transportul auto)”, nivelul I, studii superioare de licenţă, elaborat impreună cu compania germană ,, Draexlmaier Automotive”; ,,Relaţiile de muncă şi managementul resurselor umane”, nivelul II, studii superioare de masterat, elaborat impreună cu catedra de Drept privat, rerezentanţi ai instituţiilor de drept şi unităţilor economice; actualizarea programelor de studii la specialităţile ,,TIC in sistemul educaţional”, ,,Învăţămînt primar” cu suportul tehnic şi logistic al Proiectului Tempus -Teacher Education Review and Update of Curriculum (TEREC ) ş.a

Descriere succintă a modului în un nou program de studiu este momentan aprobat în universitate ∙ ∙ ∙ ∙ ∙ ∙

Elaborarea unui program de studii necesită analiza preventivă a următoarelor aspecte: este oare solicitat programul pe piaţa muncii ? Care sunt tendinţele moderne în economie, cultură şi educaţie ? dispune oare catedra, Universitatea de cadre umane calificate care vor asigura pregătirea specialiștilor ? dispune oare Universitatea de resurse, bază materială necesară care ar facilită pregatirea specialiştilor ? este oare elaborat un program de studii similar la alte universităţi din ţară, peste hotare ? care sunt tendinţele moderne în economie, cultură şi educaţie, pentru a adapta programele de studii la cerinţele faţă de un specialist modern ? este oare asigurată Biblioteca ştiinţifică cu resurse?

From Self-Assessment to External Quality Assurance

56

∙ ∙ ∙ ∙ ∙ ∙ ∙

∙ ∙ ∙ ∙ ∙

∙ ∙ ∙ ∙ ∙





Ulterior se crează grup de lucru constituit din membri ai catedrei de profil, manageri, reprezentanţi ai pieţii muncii. Programul de studii elaborat de grupul de lucru este discutat şi aprobat. În procesul de elaborare a programului de studii echipa de lucri ia în calcul prevederile stipulate în următoarele referinţe: Legea învăţămîntului nr. 547-XIII din 21 iulie 1995; Legea nr.142-XYI din 07 iulie 2005 privind aprobarea Nomenclatorului domeniilor de formare profesională şi al specialităţilor pentru pregătirea cadrelor în instituţiile de învăţămînt superior, ciclul I ; Planurilor-cadru pentru studii superioare (ciclul I - studii superioare de licenţă, ciclul II- studii superioare de masterat); Ghidului utilizatorului ECTS; Ghidului de implementare a Sistemului Naţional de Credite de Studiu, aprobat prin ordinul ministrului educaţiei, tineretului şi sportului nr. 140 din 25.02.06; Instrucţiunea de lucru al SMC USARB ,,Nota explicativă la planul de învăţământ”; Proiectarea formării în învăţământul universitar. Ghid pentru cadrele didactice universitare, autor – V. Vabac, Bălţi, 2012 Traiectoria de aprobare a unui nou program de studii în Universitatea de Stat ,,Alecu Russo” din Bălţi este următoarea: Programul de studii este discutat la ședinţa catedrei de profil; Programul este discutat la ședinţa Consililui facultăţii; Programul este avizat de Comisia acedemică a Senatului universităţii și de Departamentul pentru Managementul Calităţii; Programul este aprobat de Senatul universităţii; Programul este coordonat cu Ministerul Educaţiei al Republicii Moldova. Intenţia de a deschide un nou program de studii este coordonat cu Ministerul Educaţiei al Republicii Moldova şi preventiv, pentru a primi aprobare. Structura dosarului/portofolilui programului de studii: Programul de studiu, elaborat în conformitate cu cerinţele planului cadru; Nota explicativă la programul de studiu; Curriculumurile disciplinare ale unităţilor de curs incluse în program; Lista unităţilor de curs și a cadrelor didactice care realizează cursurile; Tabel informativ privind gardul de acoperire a cursurilor cu resurse (manuale, note de curs, curs electronic pe platformă de învăţare). Distribuirea responsabilităţilor în procesul elaborării și monitorizării dosarelor pentru aprobarea instituţională cuprinde reţeaua: grup de lucru de elaborare a programului de studii – catedra de profil-Consililui facultăţii-Comisia academică a Senatului universităţii și Departamentul pentru Managementul Calităţii -Senatul universităţii. Una din bunele practici a Universităţii de Stat ,,Alecu Russo” din Bălţi o constituie experienţa parteneriatului social şi conlucrării cu piata muncii. Cui aparţine iniţiativa deschiderii unui program de studii in cadul Universităţii de Stat ,,Alecu Russo” din Bălţi ? Diversificarea oferei educaţionale, ajustarea ei la exigenţele pieţii muncii se realizează prin: suportul tehnic şi logistic al structurilor europene prin iniţiative parvenite de la angajaţii universităţii şi/sau reprezentanţi a altor universităţi: deschiderea specialităţii ,,Asistenţă socială” prin intermediul proiectului din cadrul programului Tempus T_JEP-10012-1995 (MD) ARUB: Studiengang Sozialwesen, Martie 1995 – martie 1998; dezvoltarea cursurilor profesionalizate în vederea facilitării adaptabilităţii profesionale a specialiştilor din sfera economiei pe piaţa muncii şi eliberarea diplomelor duble cu Universitatea Clermont-Ferrand, Franţa în cadrul proiectului ,,Modernizarea şi dezvoltarea cursurilor profesionale” Nr: 144920-TEMPUS-2008-FR-JPCR; perfectarea programului de studii pentru pregatirea profesorilor d elimba şi literatură românî prin intermediul proiectului ,,P159338-TEMPUS-1-2009-1-LV-TEMPUS-SMHES ,,Dezvoltarea sistemului de învaţămint superior prin îmbunătăţirea parteneriatului social (Facultatea de Filologie); iniţiativa reprezentanţilor industriei. Astfel, în anii 2001-2002 la Institutul de Cercetări pentru culturile de câmp ,,Selecţia” din mun. Bălţi care practic nu avea specialişti tineri, majoritatea cercetătorilor fiind de vârstă pensionară, sa recurs la pregătirea viitorilor specialişti pentru instituţia nominalizată. Au fost deschise în incinta Universităţii două programe de studii -,,Agroecologie” şi ,,Agronomie”. Programele de studii ţineau cont de specificul pregătirii specialiştilor pentru Institutul de Cercetări pentru culturile de câmp ,,Selecţia” din mun. Bălţi. Circa 50-55 % din

From Self-Assessment to External Quality Assurance

57



∙ ∙





disciplinele de studiu sunt promovate piină în prezent de colaboratorii acestei instituţii. Toate tipurile de practici, majoritatea lucrărilor de laborator sunt efectuate în laboratoarele şi pe terenurile Institutului de Cercetări pentru culturile de câmp ,,Selecţia” din mun. Bălţi. În câţiva ani colectivul acestei instituţii a a devenit competitiv, avind noi angajaţi tineri. Au deja câţiva discipoli care-şi fac studiile la doctorat; iniţiativa catedrelor de profil, a mangerilor şi/sau angajaţilor. Aderarea Republicii Moldova în 2005 la procesul Bolonia a generat diversificarea programelor de studii la cele trei nivele de pregătire a specialiştilor cu studii superioare: licenţă, masterat, doctorat. Managerii subdiviziunilor universitare au explorat solicitarile pieţii şi au propus noi specialităţi şi specializării; specificarea de catre Guvern a domeniilor prioritare de pregatire a specialiştilor cu studii superioare (conform Nomenclatorului de profesii); solicitările/cererile parvenite prin feedback-ul pe care îl avem prin intermediul studenţilor după practicile pe care le realizează în diferite instituţii şi organizaţii şi iniţiativele, propunerile cu care ei vin la conferinţele de totalizare a practicii; -sugestiile enunţate de studenţi în proceul de evaluare curentă şi finală. La finele fiecărui semestru Departamentul de management al calităţii contabilizează opiniile studenţilor despre procesul de formare profesională şi solicită sugestii de îmbunătăţire. Suplimentar, la absolvirea facultăţii toţi studenţii completează on-line un chestionar care conţine informaţii eshaustive despre experienţa de formare personală a acestora în Universitate. Ulterior, se prelucrează cantitaiv şi calitativ rezultatele sondajului de opinie şi se prezintă comunităţii academice. De aceste rezultate se ţine cont în dezvoltarea politicilor de modernizare a curricula de pregătire profesională; -analiza opiniilor beneficiarilor de cursuri de reciclare şi/sau formare continuă prestate de Universitate care reprezintă piaţa de muncă a ţării. Exemplu: În anul 2011 întreprinderea germană ,, Draexlmaier Automotive” SRL, înregistrată în Zona Liberă economică Bălţi, sesizînd criză acută de manageri de nivel mijlociu (şefi de secţii, ture etc.) s-a adresat conducerii Universităţii de Stat ,,Alecu Russo” din Bălţi cu propunerea de a pregăti specialişti în domeniul ingineriei şi managementului în transportul auto. După o muncă de câteva luni a fost elaborat programul de studii la specialitatea ,,Inginerie şi management” (în transportul auto) împreună cu specialiştii de la câteva universităţi din Germania şi reprezentanţi ai industriei, care ţine cont în deosebi, de pregătirea practica a tinerilor specialişti. Mai multe cursuri sunt promovate de un grup de cadre didactice de la universităţi din Germania. Reprezentanţii ,, Draexlmaier Automotive” SRL au participat în toate etapele procesului –negocierea intenţiei de a deschide programul de studii în Universitatea bălţeană cu reprezentanţii Guvernului, elaborarea planului de studii, selectarea experţilor, procesul de predare-invaţare-evaluare, organizarea locurilor de practică ş.a Contribuţia deosebită a ,,Draxlmaier Automotive” SRL o constituie investiţia în resursele umane – cu suportul proiectului de 15.000 Euro finantat de DAAD se asigură la moment formarea continuă a universitarilor bălţeni care predau la această specialitate.

Rezultatele interviului Interviul s-a realizat la niveluri diferite (pro-rectori, decani, directori de departament, cadre didactice relevante). In interviu au participat 10 persoane – vezi anexa N 1. Interviul s-a realizat cu scopul de a enumera:

a.

Indicatori care vor putea fi ușor înţeleși și administraţi de către promotorii (Facultate / Departament) noilor programe de studiu

Rezultatele cantitative sunt prezentate în anexa N 2. Tabelul N 1 reflectă indicatorii care vor putea fi ușor înţeleși și administraţi de către promotorii (Facultate / Departament) noilor programe de studiu din perspectiva colaboratorilor incluşi în studiu.

From Self-Assessment to External Quality Assurance

58

Table N 1: Top 10 Indicatori care vor putea fi ușor înțeleși și administrați de către promotorii (Facultate / Departament) noilor programe de studiu

1.

Code indicators B 1.1.

2.

B 3.1.

3.

B 5.2.

4.

B 4.1.

5.

B 5.3.

6.

B 6.3.

7.

B 7.1.

8.

B 7.2.

9.

B 7.8.

N/o

b.

Decoding Programul de studii este autorizat şi funcţionează conform actelor normative în vigoare Conţinutul Programului de studii este orientat spre formare de competenţe Structura curriculum-ului la discipline corespunde prevederilor metodologice ale teoriei curriculare Conţinutul planului de invăţămant este in concordanţă cu misiunea şi obiectivele Programului Proiectarea taxonomică şi desfăşurarea in timp a obiectivelor este orientată spre formarea interconexă a cunoştinţelor, capacităţilor şi atitudinilor Suportul curricular este accesibil studenţilor (ca număr, ca mod de utilizare) Programul de studii se realizează in conformitate cu Regulamentul de organizare a procesului de învăţămînt Facultatea / catedra de specialitate activează în baza planurilor strategice şi operaţionale Documentaţia catedrei / facultăţii corespunde registrului de documente necesare pentru realizarea unui Program de studii

N of points (out of 10) 6 6 5 5 5

5 5 5 5

Indicatorii primordiali (din perspectiva promotorilor noilor programe)

Participanţii la interviu au fost rugaţi să nominalizeze indicatorii pe care-i consideră prioritari. Rezultatele cantitaive sunt reflectate în anexa N 3. Frecventa acestor indicatori este reflectată în anexa N 5, iar cei cu frecvenţă înaltă îi prezntăm în tabelul N 2. Table N 2: Top Top 10 Indicatorii primordiali din perspectiva promotorilor noilor programe.

1. 2.

Code indicators B 1.2. B 10.4.

3.

C 1.5.

4.

D 5.2.

N/o

Decoding Programul de studii corespunde Cadrului Naţional al Calificărilor Testele aplicate sunt elaborate corect şi întrunesc caracteristicile inerente unui instrument de evaluare Calificarea profesională a cadrelor didactice corespunde cerinţelor domeniului de formare profesională iniţială în care sunt implicate Competitivitatea absolvenţilor Programului de studii pe piaţa muncii

N of points (out of 10) 4 4 4 4

S-a menţionat, în mod special, că o direcţie importantă de îmbunătăţire a calităţii formării specialiștilor este informatizarea/internetizarea procesului de formare. Din aceste considerente trebuie consideraţi primordiali indicatorii care se referă la dotarea tehnică a sălilor de studii, numărul de studenţi ce revin la un calculator, viteza de acces la Internet, servicii de Wi-Fi în campusul universitar, numărul de cursuri pe platforma de învăţare electronică. [N1]

c.

Conform indicatorilor propuși în ghiduri, ce fel de informaţie / documentaţie sau servicii consultative pot fi facilitate sau furnizate promotorilor noilor programe de către unitatea internă de Asigurare a Calităţii în cadrul procesului de elaborare a unui nou program de studiu?

Informaţie / documentaţie sau servicii consultative aşteptate de intervievaţi a fi furnizate de la departamentul de QM în procesul de elaborare a unui nou program de studiu: ∙ un ghid metodologic de proiectare a formării în universitate; ∙ criterii, indicatori și proceduri de evaluare a programelor de studii, actualizate conform recomandărilor proiectului Tuning; ∙ informaţii despre necesitatea pe piaţa muncii a specialiştilor de domeniul respectiv; ∙ lista bazelor de practică, cu descrierea dotaţiei şi disponibilităţii lor pe perioade calendaristice;

From Self-Assessment to External Quality Assurance

59

∙ ∙ ∙ ∙ ∙ ∙ ∙ ∙ ∙ ∙ ∙

d.

rezultatele chestionării studenţilor privind strategiile didactice utilizate de profesorii, care probabil, vor asigura suportul didactic al programului; exigenţe unificate faţă de Curriculumul disciplinelor/modulelor (elemente standard); facilitarea procesului de publicare a suporturilor curriculare, inclusiv, susţinerea financiară; diseminarea rezultatelor monitorizării angajării absolvenţilor în cîmpul muncii; sugestii privind îmbunătăţirea calităţii procesului de studii; contribuirea la dezvoltarea culturii calităţii în universitate; furnizarea informaţiei referitoare la solicitarea pe piaţa muncii a specialiștilor care vor fi pregătiţi conform programului nou de studiu; consultanţă permanentă pe tot parcursul elaborării dosarului pentru noul program de studiu (acte normative, conţinutul dosarului etc.); evaluarea internă a dosarului programului nou de studiu înainte de prezentarea lui comisiei metodice a facultăţii; servicii consultative în procesul evaluării externe; informaţii cu privire la experienţa mondială de elaborare şi evaluarea planurilor de studii

Conform analizei precedente, care sunt punctele forte ale instituţiei dumneavoastră în cadrul procesului de elaborare a unui nou program?

Punctele forte ale USARB în cadrul procesului de elaborare a unui nou program: ∙ există o mică experienţă de elaborare a unui nou program în conformitate cu recomandările programului TUNING și cadrul european al calificărilor (a se vedea p. 4); ∙ experienţa de identificare a necesităţilor pieţei forţei de muncă prin conlucrare cu industria şi dezvoltarea parteneriatelor sociale; ∙ programul strategic de dezvoltare a universităţii este orientat spre elaborarea și implementarea programelor noi de studiu; ∙ Biblioteca Știinţifică a Universităţii este una din cele mai dotate din ţară; ∙ cadre didactice flexibile şi deschise spre formare în majoritate;

e.

Aţi identificat vreun domeniu de îmbunătăţire a procesului de elaborare și aprobare a unui nou program de studiu în cadrul universităţii dumneavoastră?

∙ În cadrul proiectului TEREC (Teacher Education Review and Update of Curriculum), la care participă facultatea de Știinţe Reale și facultatea de Știinţe ale Educaţiei şi Arte, a fost experimentat un proces de elaborare și aprobare a unui nou program de studiu, care corespunde recomandărilor proiectului TUNING; Procesul de elaborare începe cu conceperea unui document de bază: profilul specialităţii, care servește drept punct de pornire pentru elaborarea programului de studiu. momentul nou: profilul specialităţii conţine lista competenţelor ce urmează a fi formate/dezvoltate în cadrul programului de studiu și lista finalităţiloe formării (spre deosebire de formularea obiectivelor). În baza profilului specialităţii se elaborează programului de studiu, ţinând cont de prevederile planuluicadru pentru învăţământului superior. Pentru fiecare unitate de curs, inclusă în program, se elaborează un document scurt: descrierea unităţii de curs. În baza descrierii se elaborează planul unităţii de curs. spre deosebire de curriculumul disciplinei, planul unităţii de curs conţine harta tehnologică a unităţii de curs, în care sunt descrise toate activităţile de învăţare a studenţilor (cele realizate în regim de contact direct cu profesorul și activitatea indepedentă). aceasta permite de a dirija și a evalua activitatea de învăţare; ∙ programul de studii ,,Relaţiile de muncă şi managementul resurselor umane”, ciclul II, studii superioare de masterat, elaborat impreună cu catedra de Drept privat, rerezentanţi ai instituţiilor de drept şi unităţilor economice; ∙ programul de studii la specialitatea ,,Inginerie şi management” (în transportul auto) elaborat împreună cu specialiştii de la câteva universităţi din Germania şi reprezentanţi ai întreprinderii germane ,, Draexlmaier Automotive” SRL, înregistrată în Zona Liberă economică Bălţi.

From Self-Assessment to External Quality Assurance

60

Cahul State University “Bogdan Petriceicu Hasdeu” Ex Ante Evaluation Report (EN) 1. Goal This procedure presents the rules and responsibilities regarding the elaboration of plans and study programs (disciplinary curriculum) with the goal of establishing the faculties’ ability to correspond to the established requirements as well as to improve them.

2. Area of Application This procedure will be applied within the faculties and departments of the State University „B. P. Hasdeu” from Cahul.

3. Definitions and Abbreviations Definitions Education plan - list of disciplines, distributed over the study period, for which a certain number of lectures, seminars or practical works, laboratory works is allotted; the evaluation form is specified (exam, colloquium, test, yearly thesis (project)); a certain number of credits will be attributed so that specific competences of the faculties’ specialties’ students are formed. Curriculum (education program) – a document which determines the goal and objectives of the study discipline, the contents of the lectures, practical and laboratory works, the volume of hours assigned to various topics and forms of fulfillment evaluation; Lecture – a process of transmitting the knowledge of a discipline from the education plan in oral or mixed form (both orally and in written form), using an adequate technical-material basis; Application – the process of skills formation (during laboratory works) or putting the acquired knowledge

into practice (Project, Thesis, Seminar), a capacity resulted from the teaching process (Lecture).

Abbreviations D – Dean MD – Department methodist ECTS/SNCS PD – Deputy Dean SC – Head of Department PC – Framework Plan ST – Student C – Disciplinary Curriculum S – Seminar P – Lecture L – Laboratory work Pl. Î – Education Plan ME – Ministry of Education Tc – Course Holder T/A – Yearly thesis

4. People Responsible For The Process – RMC The responsibilities and authorities within the process are established in point 5 of this procedure.

5. Process Description Procedure rules regarding the elaboration, periodic evaluation and modernization of the education plan Activities and responsibilities are described in the table and text below: WHO RESPONSIBILITIES / AUTHORITIES Dean, Head of Department

WHAT ACTIVITIES 5.1.1. Determination of the need for the elaboration of a new education plan or the modernization of the existing one

From Self-Assessment to External Quality Assurance

HOW RECORDS Minutes: Senate Faculty Council, Department

61

Head of Department, Department members, Interested economic agents

5.1.2. Elaboration and coordination of the new education plan (amendment of the existing one)

Department Minutes: • examination, • approval

Faculty Council

5.1.3. Examination of the elaborated (amended) plan

Faculty Council Minutes, approved

Studies Division

5.1.4. Expertization of the elaborated (amended) plan

Reporting to the Senate

University Senate

5.1.5. Approval of the elaborated (amended) plan

Senate Minutes

Ministry of Education

5.1.6. Confirmation of the elaborated (amended) plan

Signature of the minister, entering in the register

Dean, Head of Department

5.1.7. Application of the education plan

Education activities’ schedule

Determination of the need for the elaboration of a new education plan or the amendment of the existing one starts from … a. Approval of a new classification of fields of specialties and professional formation; b. Need for the staff retraining for a new specialty; c. Addressing the relevant Ministries, economic agents interested in training personnel; d. Amendment of the university calendar. Elaboration and coordination of the new education plan (amendment of the existing plan) a. The team and the elaboration terms are established; b. The respective activities are carried out taking into consideration: ∙ legal requirements (Classification, Framework plan); ∙ requirements of the educational standards; ∙ requirements of the economic agents; ∙ previous experience or the experience of other university centers; Examination of the new education plan (amendment of the existing one): The project of the plan elaborated by the specialty department is submitted for examination to the Faculty Council. The Faculty Council examines the plan’s project and the president of the council (dean) approves it by signing it. The expertization of the elaborated (amended) plan: The plan which has been approved by the president of the Faculty Council is then submitted to the Studies Division for expertization, in order to ensure compliance with legal requirements and the coordination of the disciplines of the university level for all specialties. Approval of the elaborated (amended) plan: The plan which has been expertized in the Studies Division is presented to the University Senate for approval. The University Senate examines the elaborated plan and makes the decision regarding its approval. Confirmation of the elaborated (improved) plan: The plan which has been approved by the University Senate is then submitted to the Ministry of Education for confirmation and registration.

From Self-Assessment to External Quality Assurance

62

Application of the elaborated (improved) plan: The plan which has been confirmed and registered will be kept for the period of its action at the Studies Division. The copies of the plan will be available to the dean, the head of the department of the corresponding specialty. The plan comes into force starting with the new university year.

Procedure rules regarding the elaboration, period evaluation and modernization of the education plan Their activities and responsibilities are described in the table below: WHO RESPONSIBILITIES / AUTHORITIES Dean, Head of Department

WHAT ACTIVITIES 5.2.1. Determination of the need for the elaboration (improvement) of a new curriculum

HOW RECORDS Minutes: Faculty Council, Department

Discipline holder Head of the Department,

5.2.2 Elaboration of a new curriculum

Minutes: Faculty Council, Department

Department members

5.2.3. Examination of the curriculum

Minutes: Faculty Council, Department

Head of the Department Faculty Council

5.2.4. Approval of the curriculum

Minutes: Faculty Council

Dean, Head of the Department Course holder

5.2.5 Application of the curriculum

Compliance with the requirements during teaching activities

Determination of the need for the elaboration (amendment) of the discipline curriculum results from: coming into force of the new education plan; amendment of the existent education plan; advancing of the respective field; amendment of the university calendar. Elaboration of the curriculum: The provisions of the education plan regarding the forms of training, evaluation the requirements of the educational standard must be taken into consideration (see curriculum structure on next page). Examination of the curriculum: The holder of the discipline submits the curriculum to the head of the department, who analyzes it, informs the members of the department and submits the elaborated (or amended) curriculum to the department session for approval. The department session analyzes and approves the elaborated (or amended) curriculum. A decision is made to submit the curriculum to the faculty council for approval. Approval of the curriculum: The curriculum examined at the specialty department is submitted to the Faculty Council, which consists of the department which provides the respective discipline and which examines and approves the curriculum. The approval is confirmed through the signature of the dean (council president). Application of the curriculum: the approved curriculum is kept at the respective department and at the specialty department → the curriculum is applied starting with the new university year → the curriculum can be amended as needed.

From Self-Assessment to External Quality Assurance

63

.

From Self-Assessment to External Quality Assurance

64

Ex Ante Evaluation Report (RO) 1. Scop Această procedură prezintă regulile şi responsabilităţile referitoare la procesul de elaborate a planurilor şi programelor de învăţământ (curriculum disciplinar) în scopul stabilirii capacităţii facultăţilor de a îndeplini cerinţele stabilite şi a le îmbunătăţi.

2. Domeniul de Aplicare Prezenta procedură se aplică în cadrul facultăţilor şi catedrelor Universităţii de Stat „B.P.Hasdeu” din Cahul.

3. Definiţii Şi Abrevieri Definiţii Plan de învățământ - lista de discipline, ordonate pe durata studiilor, pentru care se alocă un anumit număr de ore de prelegeri (curs), seminare sau lucrări practice, lucrări de laborator; se specifică forma de verificare (examen, colocviu, test, teza (proiect) de an); se aloca un număr de credite, astfel încât să se asigure formarea competentelor specifice pentru absolvenţii facultăţii / specialităţii. Curriculum (programa de învățământ) - document care determină scopul şi obiectivele disciplinei de studiu, conţinutul prelegerilor, lucrărilor practice şi de laborator, volumul de ore repartizat pe teme şi forme de realizare/evaluare; Prelegere - proces de transmitere a cunoştinţelor la o disciplină din planul de învăţământ sub forma orală sau mixtă (oral şi scris), folosind o baza tehnicomaterială adecvată;

Aplicație - procesul de formare a deprinderilor (în cadrul lucrărilor de laborator) sau de punere în practică a cunoştinţelor (Proiect, Teză, Seminar) capacitate în urma procesului de predare (Prelegere).

Abrevieri D – Decan MD – Metodist departamental ECTS/SNCS PD – Prodecan SC – Şef catedra PC – Plan Cadru ST – Student C – Curriculum disciplinar S – Seminar P – Prelegere L – Lucrare de laborator Pl. Î – Plan de învăţământ ME – Ministerul Educaţiei Tc – Titular curs T/A – Teză de an

4. Responsabil de Proces – RMC Responsabilităţile şi autorităţile din cadrul procesului sunt stabilite în pct. 5 al actualei

5. Descrierea Procesului Reguli de procedură privind elaborarea, evaluarea periodică şi modernizarea planului de învăţământ Activităţile şi responsabilităţile acestora sunt descrise în tabelul de mai jos: CINE RESPONSABILITĂȚI / AUTORITĂȚI Decan, Şef de catedra

Şef catedră, membrii catedrei, agenţi economici cointeresati

CE ACTIVITĂȚI

CUM ÎNREGISTRĂRI

5.1.1. Determinarea necesitaţii elaborării planului de învăţământ nou sau a modificării planului existent

Proces verbal: • Senat • Consiliul Facultăţii, • Catedra

5.1.2. Elaborarea şi coordonarea planului de învăţământ nou (modificarea planului existent)

Proces verbal catedra: • examinare, • aprobare

From Self-Assessment to External Quality Assurance

65

Consiliul Facultăţii

5.1.3. Examinarea planului elaborat (modificat)

Proces verbal al Consiliu facultăţii, aprobare

Secţia studii

5.1.4. Expertizarea planului elaborat (modificat)

Informarea Senatului

Senatul Universităţii

5.1.5. Aprobarea planului elaborat (modificat)

Proces verbal al Senatului

Ministerul Educaţiei

5.1.6. Confirmarea planului elaborat (modificat)

Semnătura ministrului, trecerea în registru

Decan, Şef catedră

5.1.7. Aplicarea planului de învăţământ

Orarul activităţilor de studii

Determinarea necesitații elaborării planului de învățământ nou sau a modificării planului existent porneşte de la … a. Aprobarea unui nou Nomenclator al domeniilor de formare profesională şi al specialităţilor; b. Necesitatea pregătirii cadrelor la o noua specialitate; c. Adresarea Ministerelor de resort, agenţilor economici cointeresaţi în pregătirea cadrelor; d. Modificarea calendarului universitar. Elaborarea şi coordonarea planului de învățământ nou (modificarea planului în acțiune) a. Se stabileşte echipa şi termenii de elaborare; b. Se desfăşoară activităţile respective ţinându-se cont de: ∙ cerinţele legale (Nomenclator, Plan-cadru); ∙ cerinţele standardului educaţional; ∙ cerinţele agenţilor economici; ∙ experienţa anterioară proprie sau a altor centre universitare; Examinarea planului de învățământ nou (modificarea planului în acțiune): Proiectul planului elaborat de catedra de specialitate se înaintează spre examinare Consiliului Facultăţii. Consiliul Facultăţii examinează proiectul planului, preşedintele consiliului (decanul) îl avizează prin semnătura. Expertiza planului elaborat (modificat): Planul avizat de preşedintele Consiliului Facultăţii este înaintat la Secţia Studii pentru expertizare, în scopul de a verifica: respectarea cerinţelor legale și coordonarea disciplinelor nivelului universitar pentru toate specialităţile. Aprobarea planului elaborat (modificat): Planul expertizat în Secţia Studii este prezentat Senatului Universităţii spre aprobare. Senatul Universităţii examinează planul elaborat şi ia decizia privind aprobarea lui. Confirmarea planului elaborat (perfecționat): Planul aprobat de Senatului Universităţii este înaintat la Ministerul Educaţiei spre confirmare şi înregistrare. Aplicarea planului elaborat (perfecționat): Planul confirmat şi înregistrat se păstrează pe perioada de acţiune la Secţia Studii. Copiile planului se pun la dispoziţia decanului, şefului de catedră de la specialitatea dată. Planul intră în vigoare începând cu anul universitar nou.

Reguli de procedură privind elaborarea, evaluarea periodică şi modernizarea planului de învăţământ Activităţile şi responsabilităţile acestora sunt descrise în tabelul de mai jos:

From Self-Assessment to External Quality Assurance

66

CINE RESPONSABILITĂȚI / AUTORITĂȚI Decan, Şef catedră

CE ACTIVITĂȚI 5.2.1. Determinarea necesităţii elaborării (modificării) curriculum-ului

CUM ÎNREGISTRĂRI Proces verbal: Consiliul Facultăţii, Catedra

Titularul disciplinei Şef catedră

5.2.2 Elaborarea curriculum-ului

Proces verbal: Consiliul Facultăţii, Catedra

Membrii catedrei,

5.2.3. Examinarea curriculum-ului

Proces verbal: Consiliul Facultăţii, Catedra

Şef catedră Consiliul Facultăţii

5.2.4. Aprobarea curriculum-ului

Proces verbal: Consiliul Facultăţii

Decan, Şef catedră Titular curs

5.2.5 Aplicarea curriculum-ului

Respectarea cerinţelor în cadrul activităţilor didactice

Determinarea necesității elaborării (modificării) curriculum-ului disciplinar reiese din: intrarea în vigoare a planului de învăţământ nou; modificarea planului de învăţământ existent; avansarea domeniului respectiv; modificarea calendarului universitar. Elaborarea curriculum-ului: Se ţine cont de prevederile planului de învăţământ privind formele de instruire, de evaluare, de cerinţele standardului educaţional (vă rugăm să consultaţi structura pe pagina următoare). Examinarea curriculum-ului: Titularul disciplinei înaintează curriculum şefului de catedră. Şeful de catedră analizează, informează membrii catedrei şi înaintează la şedinţa catedrei spre aprobare curriculum elaborat (sau modificat). La şedinţa catedrei se analizează şi se aproba curriculum elaborat (sau modificările propuse). Se ia decizia de înaintare pentru aprobare la consiliul facultăţii. Aprobarea curriculum-ului: Curriculum examinat la catedra de specialitate este înaintat la Consiliul Facultăţii. Consiliul Facultăţii, în componenţa căruia se află catedra care asigura disciplina respectivă, examinează şi aprobă curriculum-ul. Aprobarea este vizată prin semnătura decanului (preşedintelui consiliului). Aplicarea curriculum-ului: curriculum aprobat este păstrat la catedra respectivă şi la catedra de specialitate → curriculum este aplicat începând cu anul universitar nou → curriculum poate fi modificat în caz de necesitate.

From Self-Assessment to External Quality Assurance

67

From Self-Assessment to External Quality Assurance

68

4. RECOMMENDATIONS FOR SITE VISITS JOSEP GRIFOLL (ENQA & AQU CATALUNYA)

Examples of the Questions ∙ ∙ ∙ ∙ ∙ ∙ ∙

The process (design and approval of new programmes) is clear and reasonable? The managers and the users are well identified? The responsibilities are well distributed? There are mechanisms that promote the quality of the new programmes? The evidences are available and they contribute to the understanding of the process? The indicators are supporting the consistency of the process? The diagnosis (SWOT analysis) is useful?

Possible Questions for the Interviews ∙ Make the questions using positive ideas. The report includes the following idea “….”; do you think this could be considered as a reference for the rest of the faculties or for other universities? ∙ Use the self-assessment statements for confirmation. (The university says “….” what do you think of this?). Is this applicable in all cases? Do crosscheck exercises with teachers and students ∙ Propose alternative scenarios (In case of “…” do you think this could be possible?) ∙ Ask for additional recommendations ∙ Confirm quantitative data. Do all audiences understand the figures and the meaning of the indicators? ∙ Ask for the staff who will be in charge of implementing improvements

Your report ∙ ∙ ∙ ∙ ∙

Short Composition of the team Agenda Analysis of the quality of the SAR (understandable, according the reality, presentation of good recommendations…) Synthetic evaluation about the situation: “our opinion is that the process is well defined and implemented according the requirements. The stakeholders play an important role but we suggest to consider….” ∙ Confirmation of the SAR recommendations and new suggestions

From Self-Assessment to External Quality Assurance

69

Smile Life

When life gives you a hundred reasons to cry, show life that you have a thousand reasons to smile

Get in touch

© Copyright 2015 - 2024 PDFFOX.COM - All rights reserved.