Evaluation in organizations: a systematic approach to enhancing learning, performance, and change
Gespeichert in:
| Beteiligte Personen: | , |
|---|---|
| Format: | Buch |
| Sprache: | Englisch |
| Veröffentlicht: |
Cambridge, Mass.
Perseus Publ.
2001
|
| Ausgabe: | 1. pr. |
| Links: | http://bvbr.bib-bvb.de:8991/F?func=service&doc_library=BVB01&local_base=BVB01&doc_number=019898834&sequence=000002&line_number=0001&func_code=DB_RECORDS&service_type=MEDIA |
| Umfang: | XIX, 474 S. Ill. |
| ISBN: | 0738202681 |
Internformat
MARC
| LEADER | 00000nam a2200000 c 4500 | ||
|---|---|---|---|
| 001 | BV025262809 | ||
| 003 | DE-604 | ||
| 005 | 00000000000000.0 | ||
| 007 | t| | ||
| 008 | 100417s2001 xx a||| |||| 00||| eng d | ||
| 020 | |a 0738202681 |9 0-7382-0268-1 | ||
| 035 | |a (OCoLC)756273503 | ||
| 035 | |a (DE-599)BVBBV025262809 | ||
| 040 | |a DE-604 |b ger |e rakwb | ||
| 041 | 0 | |a eng | |
| 049 | |a DE-11 | ||
| 084 | |a QP 340 |0 (DE-625)141861: |2 rvk | ||
| 100 | 1 | |a Russ-Eft, Darlene |e Verfasser |4 aut | |
| 245 | 1 | 0 | |a Evaluation in organizations |b a systematic approach to enhancing learning, performance, and change |c Darlene Russ-Eft ; Hallie Preskill |
| 250 | |a 1. pr. | ||
| 264 | 1 | |a Cambridge, Mass. |b Perseus Publ. |c 2001 | |
| 300 | |a XIX, 474 S. |b Ill. | ||
| 336 | |b txt |2 rdacontent | ||
| 337 | |b n |2 rdamedia | ||
| 338 | |b nc |2 rdacarrier | ||
| 700 | 1 | |a Preskill, Hallie |e Verfasser |4 aut | |
| 856 | 4 | 2 | |m HBZ Datenaustausch |q application/pdf |u http://bvbr.bib-bvb.de:8991/F?func=service&doc_library=BVB01&local_base=BVB01&doc_number=019898834&sequence=000002&line_number=0001&func_code=DB_RECORDS&service_type=MEDIA |3 Inhaltsverzeichnis |
| 943 | 1 | |a oai:aleph.bib-bvb.de:BVB01-019898834 | |
Datensatz im Suchindex
| _version_ | 1819357847400480768 |
|---|---|
| adam_text | Contents
List of Figures and Tables xi
Preface xv
Acknowledgments xix
Part I: Background and Context of Evaluation
1 Defining Evaluation 3
What Evaluation Is and Isn t, 4
The Relationship Between Evaluation and Research, 7
What Can Be Evaluated?, 10
Why Evaluate?, 11
Top Ten Reasons Evaluation Is Neglected, 16
Kinds of Evaluations, 20
Formative Evaluation, 21
Summative Evaluation, 22
The Logic of Evaluation, 26
Evaluation Use, 27
Internal and External Evaluation, 33
Internal Evaluation and Evaluators, 33
2 The Evolution of Evaluation 39
The Role of Evaluation in Today s Organizations, 39
The (Really) Early Days of Evaluation, 39
The Transformation of Evaluation into a Profession, 45
Types of Evaluation Models and Approaches, 47
The Role of Evaluation in Today s Organizations, 60
3 Evaluating Learning, Performance, and Change Initiatives 63
Future Directions for Evaluating Learning,
Performance, and Change, 63
v
vi Contents
The Role of the Learning, Performance, and Change
Professional, 64
General Models, Approaches, and Taxonomies for
Evaluation Training and Performance, 66
Research on Training Program Evaluation Models, 75
Future Directions for Evaluating Learning,
Performance, and Change, 87
4 The Politics and Ethics of Evaluation Practice 99
Ways in Which Evaluation Becomes Political, 100
Political Influences During the Evaluation, 102
Examples of Evaluation Politics, 105
Strategies for Managing the Politics of Evaluation, 107
The Ethics of Evaluation Practice, 110
Part II: Designing and Implementing the Evaluation
5 Focusing the Evaluation 127
Developing an Evaluation Plan, 129
Developing the Evaluations Rationale and Purpose, 129
Developing Key Evaluation Questions, 143
6 Selecting an Evaluation Design 147
Basic Design Issues, 148
Commonly Used Evaluation Designs, 157
7 Choosing Data Collection Methods 177
Menu of Data Collection Methods, 178
Considerations for Choosing Data Collection Methods, 183
Using Multiple Data Collection Methods, 193
8 Observation and Archival Data 197
Using Methods of Observation, 199
Observer Roles, 200
Collecting and Recording Observation Data, 203
Conducting Observations, 210
Contents vii
Advantages and Disadvantages of Collecting
Observation Data, 214
Collecting Archival Data—Records and Documents, 216
Advantages and Disadvantages of Collecting
Archival Data, 221
9 Surveys and Questionnaires 225
Types of Surveys, 228
Guidelines for Constructing Surveys, 232
Format Considerations, 248
Pilot Testing the Items and Surveys, 253
Summary of Steps in Survey Construction, 254
Logistics, 255
Handling Nonresponse Bias, 263
Managing the Data Collection Process, 264
Electronic Surveys, 265
10 Individual and Focus Group Interviews 269
Types of Interviews, 270
Determining Which Interview Approach to Use, 271
Advantages of Individual and Focus Group Interviews, 272
Guidelines for Constructing Individual and Focus Group
Interview Guides, 273
Guidelines for Conducting Individual and Focus Group
Interviews, 275
The Interviewers Role, 280
Selecting and Training Interviewers, 292
Managing the Interview Process, 296
Computer-Aided Interviewing, 297
11 Sampling 301
Approaches to Sampling, 302
Sampling Procedures, 307
Issues to Consider When Selecting a Sample, 308
12 Analyzing Evaluation Data 313
Basic Considerations for Analyzing Data, 314
viii Contents
Approaches to Qualitative Data Analysis, 318
Approaches to Quantitative Data Analysis, 327
Economic Analyses of Learning, Performance, and Change
Interventions, 337
Potential Problems in Analyzing Data, 342
Part III: Maximizing Evaluation Use
13 Communicating and Reporting Evaluation Activities and
Findings, Rosalie T. Torres 347
Purposes of Communicating and Reporting, 350
Audiences for Communicating and Reporting, 351
Timing of Communicating and Reporting, 353
Content for Communicating and Reporting, 360
Formats for Communicating and Reporting, 365
14 Planning, Managing, and Budgeting the Evaluation 381
Planning the Evaluation, 382
Managing the Evaluation, 383
Developing an Evaluation Budget, 387
15 Evaluating the Evaluation 397
Focusing the Evaluation, 399
Implementing the Evaluation, 401
Managing the Evaluation, 406
Communicating and Reporting the Evaluation s
Activities and Findings, 406
16 Strategies for Implementing Evaluation in Organizations 411
Gaining Commitment and Support for Evaluation Work, 411
Using Participatory and Collaborative Approaches, 412
Understanding the Evaluation Context, 414
Engaging in Evaluation Professional Development, 417
Choosing an Evaluator Role, 418
Contents ix
Appendix A: The Readiness for Organizational Learning and
Evaluation Instrument (ROLE) 421
References 435
Index 449
About the Authors 473
Figures and Tables
Figures
1.1 Relationship between evaluation and research 8
1.2 Reasons to evaluate 13
1.3 Top ten reasons evaluation is neglected 17
2.1 Evaluation Models and Approaches 48
3.1 Evaluating trainee reactions 77
3.2 Evaluating trainees learning 79
3.3 Evaluating training transfer 82
3.4 Evaluating training results (organizational impact) 85
3.5 Logic model for a training process 91
3.6 Variables that affect the effectiveness and impact of
learning, performance, and change interventions 94
4.1 The program evaluation standards 114
4.2 Guiding Principles for Evaluators (American Evaluation
Association, 1995) 121
5.1 Evaluation plan example—focusing the evaluation 131
5.2 Evaluation plan example—focusing the evaluation 133
5.3 American Cancer Society s Look Good. . . Feel Better
Program Logic Model (excerpt) 137
5.4 Sample purpose statements 139
7.1 Data collection methods listed in ascending order of
obtrusiveness 179
7.2 Types of measurement bias 191
xi
xii Figures and Tables
7.3 Questions to consider when choosing data collection
methods 193
8.1 Sample qualitative observation recording form 204
8.2 Taking notes during an observation 205
8.3 Sample observation checklist 207
8.4 Example of call monitoring observation form 208
8.5 Guidelines for collecting observation data 217
8.6 Sample record/document analysis form 218
8.7 Guidelines for collecting archival data 223
9.1 Examples of open-ended survey items 234
9.2 Examples of fill-in-the-blank survey items 235
9.3 Examples of two-choice or dichotomous survey items 236
9.4 Examples of multiple-choice survey items 237
9.5 Examples of Likert-type scale survey items 239
9.6 Examples of Likert scale descriptors 241
9.7 Example of behaviorally anchored survey item 243
9.8 Examples of behavior observation scale 244
9.9 Example of a ranking survey item 245
9.10 Example of paired-comparison survey item 245
9.11 The creation of a survey item 250
9.12 Example of more and less interesting survey formats 252
9.13 Announcement for group-administered survey—
manager/supervisor 257
9.14 Announcement of group-administered survey—
participant 258
9.15 Cover letter for mailed survey 259
9.16 Survey tracking form 261
10.1 Example of a recruiting script for an in-person interview 276
10.2 Example of a recruiting script for a focus-group interview 277
10.3 Example of an introduction for a telephone interview 283
10.4 Example of an introduction for a focus-group interview 284
11.1 Determining a sample size 311
Figures and Tables xiii
12.1 Decision tree for qualitative analysis 322
12.2 Example of frequency distribution of responses to
each question 328
12.3 Example of a pie chart 329
12.4 Example of frequency distribution of responses to
each question 330
13.1 Communicating and reporting purposes 352
13.2 Communicating and reporting audiences 353
13.3 Example of communicating and reporting plan 354
13.4 Communicating and reporting timing 360
13.5 Guidelines for effective communicating and
reporting content 362
13.6 Communicating and reporting formats by degree of
interaction with audience 366
13.7 Guidelines for using different communicating and
reporting formats 367
14.1 Sample data collection management plan A 384
14.2 Sample data collection management plan B 385
14.3 Sample evaluation management plan C 386
14.4 Sample evaluation data collection management plan D 388
14.5 Sample evaluation management plan E 389
14.6 Sample data collection management plan F 390
14.7 Sample data collection management plan G 390
14.8 Sample budget 394
Tables
9.1 Reaction dimensions used in reactionnaires (n = 77) 229
9.2 Common errors of question items in reactionnaires
(n = 77) 249
13.1 Typical sections and contents of comprehensive written
evaluation reports 375
|
| any_adam_object | 1 |
| author | Russ-Eft, Darlene Preskill, Hallie |
| author_facet | Russ-Eft, Darlene Preskill, Hallie |
| author_role | aut aut |
| author_sort | Russ-Eft, Darlene |
| author_variant | d r e dre h p hp |
| building | Verbundindex |
| bvnumber | BV025262809 |
| classification_rvk | QP 340 |
| ctrlnum | (OCoLC)756273503 (DE-599)BVBBV025262809 |
| discipline | Wirtschaftswissenschaften |
| edition | 1. pr. |
| format | Book |
| fullrecord | <?xml version="1.0" encoding="UTF-8"?><collection xmlns="http://www.loc.gov/MARC21/slim"><record><leader>01151nam a2200301 c 4500</leader><controlfield tag="001">BV025262809</controlfield><controlfield tag="003">DE-604</controlfield><controlfield tag="005">00000000000000.0</controlfield><controlfield tag="007">t|</controlfield><controlfield tag="008">100417s2001 xx a||| |||| 00||| eng d</controlfield><datafield tag="020" ind1=" " ind2=" "><subfield code="a">0738202681</subfield><subfield code="9">0-7382-0268-1</subfield></datafield><datafield tag="035" ind1=" " ind2=" "><subfield code="a">(OCoLC)756273503</subfield></datafield><datafield tag="035" ind1=" " ind2=" "><subfield code="a">(DE-599)BVBBV025262809</subfield></datafield><datafield tag="040" ind1=" " ind2=" "><subfield code="a">DE-604</subfield><subfield code="b">ger</subfield><subfield code="e">rakwb</subfield></datafield><datafield tag="041" ind1="0" ind2=" "><subfield code="a">eng</subfield></datafield><datafield tag="049" ind1=" " ind2=" "><subfield code="a">DE-11</subfield></datafield><datafield tag="084" ind1=" " ind2=" "><subfield code="a">QP 340</subfield><subfield code="0">(DE-625)141861:</subfield><subfield code="2">rvk</subfield></datafield><datafield tag="100" ind1="1" ind2=" "><subfield code="a">Russ-Eft, Darlene</subfield><subfield code="e">Verfasser</subfield><subfield code="4">aut</subfield></datafield><datafield tag="245" ind1="1" ind2="0"><subfield code="a">Evaluation in organizations</subfield><subfield code="b">a systematic approach to enhancing learning, performance, and change</subfield><subfield code="c">Darlene Russ-Eft ; Hallie Preskill</subfield></datafield><datafield tag="250" ind1=" " ind2=" "><subfield code="a">1. pr.</subfield></datafield><datafield tag="264" ind1=" " ind2="1"><subfield code="a">Cambridge, Mass.</subfield><subfield code="b">Perseus Publ.</subfield><subfield code="c">2001</subfield></datafield><datafield tag="300" ind1=" " ind2=" "><subfield code="a">XIX, 474 S.</subfield><subfield code="b">Ill.</subfield></datafield><datafield tag="336" ind1=" " ind2=" "><subfield code="b">txt</subfield><subfield code="2">rdacontent</subfield></datafield><datafield tag="337" ind1=" " ind2=" "><subfield code="b">n</subfield><subfield code="2">rdamedia</subfield></datafield><datafield tag="338" ind1=" " ind2=" "><subfield code="b">nc</subfield><subfield code="2">rdacarrier</subfield></datafield><datafield tag="700" ind1="1" ind2=" "><subfield code="a">Preskill, Hallie</subfield><subfield code="e">Verfasser</subfield><subfield code="4">aut</subfield></datafield><datafield tag="856" ind1="4" ind2="2"><subfield code="m">HBZ Datenaustausch</subfield><subfield code="q">application/pdf</subfield><subfield code="u">http://bvbr.bib-bvb.de:8991/F?func=service&doc_library=BVB01&local_base=BVB01&doc_number=019898834&sequence=000002&line_number=0001&func_code=DB_RECORDS&service_type=MEDIA</subfield><subfield code="3">Inhaltsverzeichnis</subfield></datafield><datafield tag="943" ind1="1" ind2=" "><subfield code="a">oai:aleph.bib-bvb.de:BVB01-019898834</subfield></datafield></record></collection> |
| id | DE-604.BV025262809 |
| illustrated | Illustrated |
| indexdate | 2024-12-20T14:24:35Z |
| institution | BVB |
| isbn | 0738202681 |
| language | English |
| oai_aleph_id | oai:aleph.bib-bvb.de:BVB01-019898834 |
| oclc_num | 756273503 |
| open_access_boolean | |
| owner | DE-11 |
| owner_facet | DE-11 |
| physical | XIX, 474 S. Ill. |
| publishDate | 2001 |
| publishDateSearch | 2001 |
| publishDateSort | 2001 |
| publisher | Perseus Publ. |
| record_format | marc |
| spellingShingle | Russ-Eft, Darlene Preskill, Hallie Evaluation in organizations a systematic approach to enhancing learning, performance, and change |
| title | Evaluation in organizations a systematic approach to enhancing learning, performance, and change |
| title_auth | Evaluation in organizations a systematic approach to enhancing learning, performance, and change |
| title_exact_search | Evaluation in organizations a systematic approach to enhancing learning, performance, and change |
| title_full | Evaluation in organizations a systematic approach to enhancing learning, performance, and change Darlene Russ-Eft ; Hallie Preskill |
| title_fullStr | Evaluation in organizations a systematic approach to enhancing learning, performance, and change Darlene Russ-Eft ; Hallie Preskill |
| title_full_unstemmed | Evaluation in organizations a systematic approach to enhancing learning, performance, and change Darlene Russ-Eft ; Hallie Preskill |
| title_short | Evaluation in organizations |
| title_sort | evaluation in organizations a systematic approach to enhancing learning performance and change |
| title_sub | a systematic approach to enhancing learning, performance, and change |
| url | http://bvbr.bib-bvb.de:8991/F?func=service&doc_library=BVB01&local_base=BVB01&doc_number=019898834&sequence=000002&line_number=0001&func_code=DB_RECORDS&service_type=MEDIA |
| work_keys_str_mv | AT russeftdarlene evaluationinorganizationsasystematicapproachtoenhancinglearningperformanceandchange AT preskillhallie evaluationinorganizationsasystematicapproachtoenhancinglearningperformanceandchange |