Kreativität: wie Sie das Unmögliche schaffen und Ihre Grenzen überwinden
Gespeichert in:
Beteilige Person: | |
---|---|
Format: | Buch |
Sprache: | Deutsch |
Veröffentlicht: |
Stuttgart
Klett-Cotta
1999
|
Ausgabe: | 4. Aufl. |
Schlagwörter: | |
Links: | http://bvbr.bib-bvb.de:8991/F?func=service&doc_library=BVB01&local_base=BVB01&doc_number=009115928&sequence=000001&line_number=0001&func_code=DB_RECORDS&service_type=MEDIA |
Umfang: | 646 S. |
ISBN: | 3608917748 |
Internformat
MARC
LEADER | 00000nam a2200000 c 4500 | ||
---|---|---|---|
001 | BV013364612 | ||
003 | DE-604 | ||
005 | 20020121 | ||
007 | t| | ||
008 | 000928s1999 gw |||| 00||| ger d | ||
020 | |a 3608917748 |9 3-608-91774-8 | ||
035 | |a (OCoLC)174515671 | ||
035 | |a (DE-599)BVBBV013364612 | ||
040 | |a DE-604 |b ger |e rakwb | ||
041 | 0 | |a ger | |
044 | |a gw |c DE | ||
049 | |a DE-N32 |a DE-1049 |a DE-91 |a DE-11 |a DE-523 | ||
084 | |a CR 5000 |0 (DE-625)19033: |2 rvk | ||
084 | |a PSY 330f |2 stub | ||
100 | 1 | |a Csikszentmihalyi, Mihaly |d 1934-2021 |e Verfasser |0 (DE-588)120827573 |4 aut | |
240 | 1 | 0 | |a Creativity |
245 | 1 | 0 | |a Kreativität |b wie Sie das Unmögliche schaffen und Ihre Grenzen überwinden |c Mihaly Csikszentmihalyi |
250 | |a 4. Aufl. | ||
264 | 1 | |a Stuttgart |b Klett-Cotta |c 1999 | |
300 | |a 646 S. | ||
336 | |b txt |2 rdacontent | ||
337 | |b n |2 rdamedia | ||
338 | |b nc |2 rdacarrier | ||
650 | 0 | 7 | |a Kreativität |0 (DE-588)4032903-3 |2 gnd |9 rswk-swf |
650 | 0 | 7 | |a Entdeckung |0 (DE-588)4014841-5 |2 gnd |9 rswk-swf |
650 | 0 | 7 | |a Kreatives Denken |0 (DE-588)4165549-7 |2 gnd |9 rswk-swf |
650 | 0 | 7 | |a Erfindung |0 (DE-588)4015223-6 |2 gnd |9 rswk-swf |
689 | 0 | 0 | |a Entdeckung |0 (DE-588)4014841-5 |D s |
689 | 0 | 1 | |a Kreativität |0 (DE-588)4032903-3 |D s |
689 | 0 | |8 1\p |5 DE-604 | |
689 | 1 | 0 | |a Erfindung |0 (DE-588)4015223-6 |D s |
689 | 1 | 1 | |a Kreativität |0 (DE-588)4032903-3 |D s |
689 | 1 | |8 2\p |5 DE-604 | |
689 | 2 | 0 | |a Kreatives Denken |0 (DE-588)4165549-7 |D s |
689 | 2 | 1 | |a Kreativität |0 (DE-588)4032903-3 |D s |
689 | 2 | |8 3\p |5 DE-604 | |
856 | 4 | 2 | |m Digitalisierung Bibliothek HTW Berlin |q application/pdf |u http://bvbr.bib-bvb.de:8991/F?func=service&doc_library=BVB01&local_base=BVB01&doc_number=009115928&sequence=000001&line_number=0001&func_code=DB_RECORDS&service_type=MEDIA |3 Inhaltsverzeichnis |
883 | 1 | |8 1\p |a cgwrk |d 20201028 |q DE-101 |u https://d-nb.info/provenance/plan#cgwrk | |
883 | 1 | |8 2\p |a cgwrk |d 20201028 |q DE-101 |u https://d-nb.info/provenance/plan#cgwrk | |
883 | 1 | |8 3\p |a cgwrk |d 20201028 |q DE-101 |u https://d-nb.info/provenance/plan#cgwrk | |
943 | 1 | |a oai:aleph.bib-bvb.de:BVB01-009115928 |
Datensatz im Suchindex
DE-BY-TUM_call_number | 0002 PSY 330f 2003 A 11620 |
---|---|
DE-BY-TUM_katkey | 1246624 |
DE-BY-TUM_location | 00 |
DE-BY-TUM_media_number | 040040051070 |
_version_ | 1821995890084151296 |
adam_text |
BRIEF
CONTENTS
1 YY UNDERSTANDING
LARGE LANGUAGE MODELS 1
2 YY
WORKING WITH TEXT DATA 17
3 YY CODING ATTENTION
MECHANISMS 50
4 YY IMPLEMENTING A
GPT MODEL FROM SCRATCH TO
GENERATE
TEXT 92
5
YY PRETRAINING
ON UNLABELED DATA 128
6 YY FINE-TUNING FOR
CLASSIFICATION 169
7 YY
FINE-TUNING TO FOLLOW INSTRUCTIONS 204
A
YY
INTRODUCTION TO PYTORCH
251
B
YY
REFERENCES
AND FURTHER READING 289
C
YY
EXERCISE SOLUTIONS 300
D
YY
ADDING BELLS AND WHISTLES TO THE TRAINING LOOP 313
E
YY
PARAMETER-EFFICIENT FINE-TUNING WITH LORA
322
CONTENTS
PREFACE
XI
ACKNOWLEDGMENTS
XIII
ABOUT THIS BOOK XV
ABOUT THE
AUTHOR XIX
ABOUT THE COVER
ILLUSTRATION XX
UNDERSTANDING
LARGE
LANGUAGE MODELS
1
1.1
WHAT
IS AN LLM? 2
1.2
APPLICATIONS
OF LLMS
4
1.3
STAGES
OF BUILDING AND
USING LLMS 5
1.4
INTRODUCING
THE TRANSFORMER
ARCHITECTURE 7
1.5 UTILIZING LARGE DATASETS
10
1.6
A
CLOSER
LOOK AT THE GPT ARCHITECTURE 12
1.7
BUILDING
A LARGE LANGUAGE MODEL
14
WORKING
WITH TEXT DATA
17
2.1
UNDERSTANDING
WORD
EMBEDDINGS 18
2.2
TOKENIZING TEXT 21
2.3 CONVERTING
TOKENS INTO TOKEN IDS
24
2.4
ADDING SPECIAL CONTEXT TOKENS
29
VII
VIII
CONTENTS
2.5
BYTE
PAIR ENCODING
33
2.6
DATA
SAMPLING WITH A
SLIDING WINDOW 35
2.7 CREATING TOKEN EMBEDDINGS
41
2.8
ENCODING
WORD POSITIONS
43
3
CODING
ATTENTION MECHANISMS
50
3.1
THE
PROBLEM WITH
MODELING LONG SEQUENCES 52
3.2
CAPTURING
DATA
DEPENDENCIES WITH ATTENTION
MECHANISMS
54
3.3
ATTENDING
TO DIFFERENT PARTS
OF THE INPUT WITH
SELF-ATTENTION
55
A SIMPLE SELF-ATTENTION MECHANISM WITHOUT
TRAINABLE WEIGHTS 56
COMPUTING ATTENTION WEIGHTS
FOR ALL INPUT TOKENS 61
3.4
IMPLEMENTING SELF-ATTENTION WITH TRAINABLE
WEIGHTS 64
COMPUTING THE ATTENTION WEIGHTS STEP BY STEP
65 YY IMPLEMENTING A
COMPACT SELF-ATTENTION PYTHON CLASS 70
3.5
HIDING
FUTURE WORDS WITH
CAUSAL ATTENTION 74
APPLYING A CAUSAL ATTENTION MASK 75 YY MASKING ADDITIONAL
ATTENTION WEIGHTS WITH DROPOUT 78 YY
IMPLEMENTING A COMPACT
CAUSAL ATTENTION CLASS 80
3.6
EXTENDING
SINGLE-HEAD ATTENTION TO MULTI-HEAD
ATTENTION 82
STACKING MULTIPLE SINGLE-HEAD
ATTENTION LAYERS 82 YY IMPLEMENTING
MULTI-HEAD ATTENTION WITH WEIGHT SPLITS 86
4
IMPLEMENTING
A GPT MODEL
FROM SCRATCH TO GENERATE TEXT 92
4.1
CODING AN LLM ARCHITECTURE
93
4.2
NORMALIZING
ACTIVATIONS WITH LAYER
NORMALIZATION 99
4.3
IMPLEMENTING
A FEED FORWARD NETWORK WITH
GELU
ACTIVATIONS
105
4.4
ADDING
SHORTCUT
CONNECTIONS 109
4.5
CONNECTING
ATTENTION AND LINEAR
LAYERS IN A TRANSFORMER
BLOCK
113
4.6
CODING
THE GPT MODEL 117
4.7
GENERATING TEXT
122
CONTENTS
IX
PRETRAINING
ON UNLABELED DATA 128
5.1
EVALUATING
GENERATIVE TEXT MODELS 129
USING GPT TO GENERATE TEXT 130 YY CALCULATING THE TEXT
GENERATION LOSS 132 YY CALCULATING THE TRAINING AND VALIDATION
SET
LOSSES
140
5.2
TRAINING
AN LLM 146
5.3 DECODING STRATEGIES TO CONTROL RANDOMNESS 151
TEMPERATURE SCALING 152 YY TOP-K SAMPLING 155
MODIFYING THE TEXT GENERATION FUNCTION 157
5.4
LOADING AND SAVING MODEL WEIGHTS IN PYTORCH 159
5.5
LOADING PRETRAINED WEIGHTS FROM OPENAI 160
6
FINE-TUNING FOR CLASSIFICATION 169
6.1
DIFFERENT
CATEGORIES OF FINE-TUNING 170
6.2
PREPARING
THE DATASET
172
6.3
CREATING
DATA LOADERS 175
6.4
INITIALIZING
A MODEL WITH PRETRAINED WEIGHTS 181
6.5 ADDING A CLASSIFICATION HEAD 183
6.6 CALCULATING THE CLASSIFICATION LOSS AND ACCURACY 190
6.7
FINE-TUNING THE
MODEL ON SUPERVISED DATA 195
6.8 USING THE LLM AS A SPAM CLASSIFIER 200
FINE-TUNING
TO FOLLOW INSTRUCTIONS 204
7.1
INTRODUCTION
TO INSTRUCTION FINE-TUNING 205
7.2
PREPARING
A DATASET FOR SUPERVISED INSTRUCTION
FINE-TUNING 207
7.3
ORGANIZING DATA INTO TRAINING BATCHES 211
7.4
CREATING
DATA LOADERS FOR AN INSTRUCTION DATASET 223
7.5
LOADING A PRETRAINED LLM 226
7.6 FINE-TUNING THE LLM ON INSTRUCTION DATA 229
7.7 EXTRACTING AND SAVING RESPONSES
233
7.8 EVALUATING THE FINE-TUNED LLM 238
7.9 CONCLUSIONS 247
WHAT'S
NEXT? 247
YY STAYING UP TO DATE IN A FAST-MOVING
FIELD 248 YY FINAL WORDS 248
X
CONTENTS
APPENDIX
A
INTRODUCTION
TO PYTORCH
251
APPENDIX B
REFERENCES AND
FURTHER READING 289
APPENDIX C
EXERCISE SOLUTIONS
300
APPENDIX D
ADDING BELLS
AND WHISTLES TO THE
TRAINING LOOP
313
APPENDIX
E
PARAMETER-EFFICIENT
FINE-TUNING WITH
LORA 322
INDEX
337
I'S
NE
IN(
AS
HA
ME
ERR
TO
TOR
AN(
EN(
TICS]
WIT
EVE
DO:
YOU
WO:
THE |
any_adam_object | 1 |
author | Csikszentmihalyi, Mihaly 1934-2021 |
author_GND | (DE-588)120827573 |
author_facet | Csikszentmihalyi, Mihaly 1934-2021 |
author_role | aut |
author_sort | Csikszentmihalyi, Mihaly 1934-2021 |
author_variant | m c mc |
building | Verbundindex |
bvnumber | BV013364612 |
classification_rvk | CR 5000 |
classification_tum | PSY 330f |
ctrlnum | (OCoLC)174515671 (DE-599)BVBBV013364612 |
discipline | Psychologie |
edition | 4. Aufl. |
format | Book |
fullrecord | <?xml version="1.0" encoding="UTF-8"?><collection xmlns="http://www.loc.gov/MARC21/slim"><record><leader>00000nam a2200000 c 4500</leader><controlfield tag="001">BV013364612</controlfield><controlfield tag="003">DE-604</controlfield><controlfield tag="005">20020121</controlfield><controlfield tag="007">t|</controlfield><controlfield tag="008">000928s1999 gw |||| 00||| ger d</controlfield><datafield tag="020" ind1=" " ind2=" "><subfield code="a">3608917748</subfield><subfield code="9">3-608-91774-8</subfield></datafield><datafield tag="035" ind1=" " ind2=" "><subfield code="a">(OCoLC)174515671</subfield></datafield><datafield tag="035" ind1=" " ind2=" "><subfield code="a">(DE-599)BVBBV013364612</subfield></datafield><datafield tag="040" ind1=" " ind2=" "><subfield code="a">DE-604</subfield><subfield code="b">ger</subfield><subfield code="e">rakwb</subfield></datafield><datafield tag="041" ind1="0" ind2=" "><subfield code="a">ger</subfield></datafield><datafield tag="044" ind1=" " ind2=" "><subfield code="a">gw</subfield><subfield code="c">DE</subfield></datafield><datafield tag="049" ind1=" " ind2=" "><subfield code="a">DE-N32</subfield><subfield code="a">DE-1049</subfield><subfield code="a">DE-91</subfield><subfield code="a">DE-11</subfield><subfield code="a">DE-523</subfield></datafield><datafield tag="084" ind1=" " ind2=" "><subfield code="a">CR 5000</subfield><subfield code="0">(DE-625)19033:</subfield><subfield code="2">rvk</subfield></datafield><datafield tag="084" ind1=" " ind2=" "><subfield code="a">PSY 330f</subfield><subfield code="2">stub</subfield></datafield><datafield tag="100" ind1="1" ind2=" "><subfield code="a">Csikszentmihalyi, Mihaly</subfield><subfield code="d">1934-2021</subfield><subfield code="e">Verfasser</subfield><subfield code="0">(DE-588)120827573</subfield><subfield code="4">aut</subfield></datafield><datafield tag="240" ind1="1" ind2="0"><subfield code="a">Creativity</subfield></datafield><datafield tag="245" ind1="1" ind2="0"><subfield code="a">Kreativität</subfield><subfield code="b">wie Sie das Unmögliche schaffen und Ihre Grenzen überwinden</subfield><subfield code="c">Mihaly Csikszentmihalyi</subfield></datafield><datafield tag="250" ind1=" " ind2=" "><subfield code="a">4. Aufl.</subfield></datafield><datafield tag="264" ind1=" " ind2="1"><subfield code="a">Stuttgart</subfield><subfield code="b">Klett-Cotta</subfield><subfield code="c">1999</subfield></datafield><datafield tag="300" ind1=" " ind2=" "><subfield code="a">646 S.</subfield></datafield><datafield tag="336" ind1=" " ind2=" "><subfield code="b">txt</subfield><subfield code="2">rdacontent</subfield></datafield><datafield tag="337" ind1=" " ind2=" "><subfield code="b">n</subfield><subfield code="2">rdamedia</subfield></datafield><datafield tag="338" ind1=" " ind2=" "><subfield code="b">nc</subfield><subfield code="2">rdacarrier</subfield></datafield><datafield tag="650" ind1="0" ind2="7"><subfield code="a">Kreativität</subfield><subfield code="0">(DE-588)4032903-3</subfield><subfield code="2">gnd</subfield><subfield code="9">rswk-swf</subfield></datafield><datafield tag="650" ind1="0" ind2="7"><subfield code="a">Entdeckung</subfield><subfield code="0">(DE-588)4014841-5</subfield><subfield code="2">gnd</subfield><subfield code="9">rswk-swf</subfield></datafield><datafield tag="650" ind1="0" ind2="7"><subfield code="a">Kreatives Denken</subfield><subfield code="0">(DE-588)4165549-7</subfield><subfield code="2">gnd</subfield><subfield code="9">rswk-swf</subfield></datafield><datafield tag="650" ind1="0" ind2="7"><subfield code="a">Erfindung</subfield><subfield code="0">(DE-588)4015223-6</subfield><subfield code="2">gnd</subfield><subfield code="9">rswk-swf</subfield></datafield><datafield tag="689" ind1="0" ind2="0"><subfield code="a">Entdeckung</subfield><subfield code="0">(DE-588)4014841-5</subfield><subfield code="D">s</subfield></datafield><datafield tag="689" ind1="0" ind2="1"><subfield code="a">Kreativität</subfield><subfield code="0">(DE-588)4032903-3</subfield><subfield code="D">s</subfield></datafield><datafield tag="689" ind1="0" ind2=" "><subfield code="8">1\p</subfield><subfield code="5">DE-604</subfield></datafield><datafield tag="689" ind1="1" ind2="0"><subfield code="a">Erfindung</subfield><subfield code="0">(DE-588)4015223-6</subfield><subfield code="D">s</subfield></datafield><datafield tag="689" ind1="1" ind2="1"><subfield code="a">Kreativität</subfield><subfield code="0">(DE-588)4032903-3</subfield><subfield code="D">s</subfield></datafield><datafield tag="689" ind1="1" ind2=" "><subfield code="8">2\p</subfield><subfield code="5">DE-604</subfield></datafield><datafield tag="689" ind1="2" ind2="0"><subfield code="a">Kreatives Denken</subfield><subfield code="0">(DE-588)4165549-7</subfield><subfield code="D">s</subfield></datafield><datafield tag="689" ind1="2" ind2="1"><subfield code="a">Kreativität</subfield><subfield code="0">(DE-588)4032903-3</subfield><subfield code="D">s</subfield></datafield><datafield tag="689" ind1="2" ind2=" "><subfield code="8">3\p</subfield><subfield code="5">DE-604</subfield></datafield><datafield tag="856" ind1="4" ind2="2"><subfield code="m">Digitalisierung Bibliothek HTW Berlin</subfield><subfield code="q">application/pdf</subfield><subfield code="u">http://bvbr.bib-bvb.de:8991/F?func=service&doc_library=BVB01&local_base=BVB01&doc_number=009115928&sequence=000001&line_number=0001&func_code=DB_RECORDS&service_type=MEDIA</subfield><subfield code="3">Inhaltsverzeichnis</subfield></datafield><datafield tag="883" ind1="1" ind2=" "><subfield code="8">1\p</subfield><subfield code="a">cgwrk</subfield><subfield code="d">20201028</subfield><subfield code="q">DE-101</subfield><subfield code="u">https://d-nb.info/provenance/plan#cgwrk</subfield></datafield><datafield tag="883" ind1="1" ind2=" "><subfield code="8">2\p</subfield><subfield code="a">cgwrk</subfield><subfield code="d">20201028</subfield><subfield code="q">DE-101</subfield><subfield code="u">https://d-nb.info/provenance/plan#cgwrk</subfield></datafield><datafield tag="883" ind1="1" ind2=" "><subfield code="8">3\p</subfield><subfield code="a">cgwrk</subfield><subfield code="d">20201028</subfield><subfield code="q">DE-101</subfield><subfield code="u">https://d-nb.info/provenance/plan#cgwrk</subfield></datafield><datafield tag="943" ind1="1" ind2=" "><subfield code="a">oai:aleph.bib-bvb.de:BVB01-009115928</subfield></datafield></record></collection> |
id | DE-604.BV013364612 |
illustrated | Not Illustrated |
indexdate | 2025-01-22T15:01:27Z |
institution | BVB |
isbn | 3608917748 |
language | German |
oai_aleph_id | oai:aleph.bib-bvb.de:BVB01-009115928 |
oclc_num | 174515671 |
open_access_boolean | |
owner | DE-N32 DE-1049 DE-91 DE-BY-TUM DE-11 DE-523 |
owner_facet | DE-N32 DE-1049 DE-91 DE-BY-TUM DE-11 DE-523 |
physical | 646 S. |
publishDate | 1999 |
publishDateSearch | 1999 |
publishDateSort | 1999 |
publisher | Klett-Cotta |
record_format | marc |
spellingShingle | Csikszentmihalyi, Mihaly 1934-2021 Kreativität wie Sie das Unmögliche schaffen und Ihre Grenzen überwinden Kreativität (DE-588)4032903-3 gnd Entdeckung (DE-588)4014841-5 gnd Kreatives Denken (DE-588)4165549-7 gnd Erfindung (DE-588)4015223-6 gnd |
subject_GND | (DE-588)4032903-3 (DE-588)4014841-5 (DE-588)4165549-7 (DE-588)4015223-6 |
title | Kreativität wie Sie das Unmögliche schaffen und Ihre Grenzen überwinden |
title_alt | Creativity |
title_auth | Kreativität wie Sie das Unmögliche schaffen und Ihre Grenzen überwinden |
title_exact_search | Kreativität wie Sie das Unmögliche schaffen und Ihre Grenzen überwinden |
title_full | Kreativität wie Sie das Unmögliche schaffen und Ihre Grenzen überwinden Mihaly Csikszentmihalyi |
title_fullStr | Kreativität wie Sie das Unmögliche schaffen und Ihre Grenzen überwinden Mihaly Csikszentmihalyi |
title_full_unstemmed | Kreativität wie Sie das Unmögliche schaffen und Ihre Grenzen überwinden Mihaly Csikszentmihalyi |
title_short | Kreativität |
title_sort | kreativitat wie sie das unmogliche schaffen und ihre grenzen uberwinden |
title_sub | wie Sie das Unmögliche schaffen und Ihre Grenzen überwinden |
topic | Kreativität (DE-588)4032903-3 gnd Entdeckung (DE-588)4014841-5 gnd Kreatives Denken (DE-588)4165549-7 gnd Erfindung (DE-588)4015223-6 gnd |
topic_facet | Kreativität Entdeckung Kreatives Denken Erfindung |
url | http://bvbr.bib-bvb.de:8991/F?func=service&doc_library=BVB01&local_base=BVB01&doc_number=009115928&sequence=000001&line_number=0001&func_code=DB_RECORDS&service_type=MEDIA |
work_keys_str_mv | AT csikszentmihalyimihaly creativity AT csikszentmihalyimihaly kreativitatwiesiedasunmoglicheschaffenundihregrenzenuberwinden |
Inhaltsverzeichnis
Paper/Kapitel scannen lassen
Paper/Kapitel scannen lassen
Teilbibliothek Stammgelände
Signatur: |
0002 PSY 330f 2003 A 11620 Lageplan |
---|---|
Exemplar 1 | Ausleihbar Am Standort |