Multimedia semantics: metadata, analysis, and interaction
Gespeichert in:
| Beteilige Person: | |
|---|---|
| Format: | Buch |
| Sprache: | Englisch |
| Veröffentlicht: |
Chichester, West Sussex, U.K.
Wiley
2011
|
| Schlagwörter: | |
| Links: | http://bvbr.bib-bvb.de:8991/F?func=service&doc_library=BVB01&local_base=BVB01&doc_number=024586284&sequence=000002&line_number=0001&func_code=DB_RECORDS&service_type=MEDIA |
| Beschreibung: | Includes bibliographical references and index |
| Umfang: | X, 305 S. Ill. |
| ISBN: | 9780470747001 |
Internformat
MARC
| LEADER | 00000nam a2200000zc 4500 | ||
|---|---|---|---|
| 001 | BV039738557 | ||
| 003 | DE-604 | ||
| 005 | 20120326 | ||
| 007 | t| | ||
| 008 | 111202s2011 xxua||| |||| 00||| eng d | ||
| 010 | |a 2011001669 | ||
| 020 | |a 9780470747001 |c cloth |9 978-0-470-74700-1 | ||
| 035 | |a (OCoLC)764281519 | ||
| 035 | |a (DE-599)BVBBV039738557 | ||
| 040 | |a DE-604 |b ger |e aacr | ||
| 041 | 0 | |a eng | |
| 044 | |a xxu |c US | ||
| 049 | |a DE-355 | ||
| 050 | 0 | |a QA76.575 | |
| 082 | 0 | |a 006.7 | |
| 084 | |a ST 270 |0 (DE-625)143638: |2 rvk | ||
| 100 | 1 | |a Troncy, Raphael |e Verfasser |4 aut | |
| 245 | 1 | 0 | |a Multimedia semantics |b metadata, analysis, and interaction |c Raphael Troncy ; Benoit Huet; Simon Schenk |
| 264 | 1 | |a Chichester, West Sussex, U.K. |b Wiley |c 2011 | |
| 300 | |a X, 305 S. |b Ill. | ||
| 336 | |b txt |2 rdacontent | ||
| 337 | |b n |2 rdamedia | ||
| 338 | |b nc |2 rdacarrier | ||
| 500 | |a Includes bibliographical references and index | ||
| 650 | 4 | |a Multimedia systems | |
| 650 | 4 | |a Semantic computing | |
| 650 | 4 | |a Information retrieval | |
| 650 | 4 | |a Database searching | |
| 650 | 4 | |a Metadata | |
| 650 | 0 | 7 | |a Recherche |0 (DE-588)4121560-6 |2 gnd |9 rswk-swf |
| 650 | 0 | 7 | |a Information Retrieval |0 (DE-588)4072803-1 |2 gnd |9 rswk-swf |
| 650 | 0 | 7 | |a Semantisches Datenmodell |0 (DE-588)4314515-2 |2 gnd |9 rswk-swf |
| 689 | 0 | 0 | |a Semantisches Datenmodell |0 (DE-588)4314515-2 |D s |
| 689 | 0 | 1 | |a Information Retrieval |0 (DE-588)4072803-1 |D s |
| 689 | 0 | 2 | |a Recherche |0 (DE-588)4121560-6 |D s |
| 689 | 0 | |5 DE-604 | |
| 700 | 1 | |a Huet, Benoit |e Sonstige |4 oth | |
| 700 | 1 | |a Schenk, Simon |e Sonstige |4 oth | |
| 856 | 4 | 2 | |m HBZ Datenaustausch |q application/pdf |u http://bvbr.bib-bvb.de:8991/F?func=service&doc_library=BVB01&local_base=BVB01&doc_number=024586284&sequence=000002&line_number=0001&func_code=DB_RECORDS&service_type=MEDIA |3 Inhaltsverzeichnis |
| 943 | 1 | |a oai:aleph.bib-bvb.de:BVB01-024586284 | |
Datensatz im Suchindex
| _version_ | 1819322507249844224 |
|---|---|
| adam_text | Titel: Multimedia semantics
Autor: Troncy, Raphael
Jahr: 2011
Contents
Foreword xi
List of Figures xiii
List of Tables xvii
List of Contributors xix
1 Introduction 1
Raphael Troncy, Benoit Huet and Simon Schenk
2 Use Case Scenarios 7
Werner Bailer, Susanne Boll, Oscar Celina,
Michael Hausenblas and Yves Raimond
2.1 Photo Use Case 8
2.1.1 Motivating Examples 8
2.1.2 Semantic Description of Photos Today 9
2.1.3 Services We Need for Photo Collections 10
2.2 Music Use Case 10
2.2.1 Semantic Description of Music Assets 11
2.2.2 Music Recommendation and Discovery 12
2.2.3 Management of Personal Music Collections 13
2.3 Annotation in Professional Media Production and Archiving 14
2.3.1 Motivating Examples 15
2.3.2 Requirements for Content Annotation 17
2.4 Discussion 18
Acknowledgements 19
3 Canonical Processes of Semantically Annotated
Media Production 21
Lynda Hardman, Zeljko Obrenovic and Frank Nack
3.1 Canonical Processes 22
3.1.1 Premeditate 23
3.1.2 Create Media Asset 23
3.1.3 Annotate 23
3.1.4 Package 24
3.7.5 Query
3.1.6 Construct Message
3.1.7 Organize
3.1.8 Publish
3.1.9 Distribute
Example Systems
3.2.1 CeWe Color Photo Book
3.2.2 SenseCam
Conclusion and Future Work
Contents
24
25
25
26
26
3.2 Example Systems 27
27
29
3.3 Conclusion and Future Work 33
4 Feature Extraction for Multimedia Analysis 35
Rachid Benmokhtar, Benoit Huet,
Gael Richard and Slim Essid
4.1 Low-Level Feature Extraction 36
4.1.1 What Are Relevant Low-Level Features? 36
4.1.2 Visual Descriptors 36
4.1.3 Audio Descriptors 45
4.2 Feature Fusion and Multi-modality 54
4.2.1 Feature Normalization 54
4.2.2 Homogeneous Fusion 55
4.2.3 Cross-modal Fusion 56
4.3 Conclusion 58
5 Machine Learning Techniques for Multimedia Analysis 59
Slim Essid, Marine Campedel, Gael Richard, Tomas Piatrik,
Rachid Benmokhtar and Benoit Huet
5.1
5.2
5.3
5.4
Feature Selection 61
5.7.7 Selection Criteria 61
5.7.2 Subset Search 62
5.7.5 Feature Ranking 63
5.7.4 A Supervised Algorithm Example 63
Classification 65
5.2.7 Historical Classification Algorithms 65
5.2.2 Kernel Methods 67
5.2.3 Classifying Sequences 71
5.2.4 Biologically Inspired Machine Learning Techniques 73
Classifier Fusion 75
5.3.1 Introduction 75
5.3.2 Non-trainable Combiners 75
5.3.3 Trainable Combiners 76
5.3.4 Combination of Weak Classifiers 77
5.3.5 Evidence Theory 78
5.3.6 Consensual Clustering 78
5.3.7 Classifier Fusion Properties 80
Conclusion 80
Contents vii
6 Semantic Web Basics 81
Eyal Oren and Simon Schenk
6.1 The Semantic Web 82
6.2 RDF 83
6.2.1 RDF Graphs 86
6.2.2 Named Graphs 87
6.2.3 RDF Semantics 88
6.3 RDF Schema 90
6.4 Data Models 93
6.5 Linked Data Principles 94
6.5.1 Dereferencing Using Basic Web Look-up 95
6.5.2 Dereferencing Using HTTP 303 Redirects 95
6.6 Development Practicalities 96
6.6.1 Data Stores 97
6.6.2 Toolkits 97
7 Semantic Web Languages 99
Antoine Isaac, Simon Schenk and Ansgar Scherp
7.1 The Need for Ontologies on the Semantic Web 100
7.2 Representing Ontologica! Knowledge Using OWL 100
7.2.7 OWL Constructs and OWL Syntax 100
7.2.2 The Formal Semantics of OWL and its Different Layers 102
7.2.3 Reasoning Tasks 106
7.2.4 OWL Flavors 107
7.2.5 Beyond OWL 107
7.3 A Language to Represent Simple Conceptual Vocabularies: SKOS 108
7.3.1 Ontologies versus Knowledge Organization Systems 108
7.3.2 Representing Concept Schemes Using SKOS 109
7.3.3 Characterizing Concepts beyond SKOS 111
7.3.4 Using SKOS Concept Schemes on the Semantic Web 112
7.4 Querying on the Semantic Web 113
7.4.1 Syntax 113
7.4.2 Semantics 118
7.4.3 Default Negation in SPARQL 123
7.4.4 Well-Formed Queries 124
7.4.5 Querying for Multimedia Metadata 124
7.4.6 Partitioning Datasets 126
7.4.7 Related Work 127
8 Multimedia Metadata Standards 129
Peter Schallauer, Werner Bailer, Raphaël Troncy and Florian Kaiser
8.1 Selected Standards 130
8.1.1 MPEG-7 130
8.1.2 EBUPJAeta 132
8.1.3 SMPTE Metadata Standards 133
8.1.4 Dublin Core
8.1.5 TV-Anytime
8.1.6 METS and VRA
8.1.7 MPEG-21
8.1.8 XMP, ¡PTC in XMP
8.1.9 EXIF
8.1.10 D1G35
8.1.11 ID3/MP3
8.1.12 NewsML G2 and rNews
8.1.13 W3C Ontology for Media Resources
8.1.14 EBUCore
8.2 Comparison
8.3 Conclusion
Contents
133
134
134
135
135
136
137
137
138
138
139
140
143
9 The Core Ontology for Multimedia 145
Thomas Franz, Raphaël Troncy and Miroslav Vacura
9.1 Introduction 145
9.2 A Multimedia Presentation for Granddad 146
9.3 Related Work 149
9.4 Requirements for Designing a Multimedia Ontology 150
9.5 A Formal Representation for MPEG-7 150
9.5.1 DOLCE as Modeling Basis 151
9.5.2 Multimedia Patterns 151
9.5.3 Basic Patterns 155
9.5.4 Comparison with Requirements 157
9.6 Granddad s Presentation Explained by COMM 157
9.7 Lessons Learned 159
9.8 Conclusion 160
10 Knowledge-Driven Segmentation and Classification 163
Thanos Athanasiadis, Phivos Mylonas, Georgios Th. Papadopoulos, Vasileios
Mezaris, Yannis Avrithis, Ioannis Kompatsiaris and Michael G. Strintzis
10.1 Related Work 164
10.2 Semantic Image Segmentation 165
70.2./ Graph Representation of an Image 165
10.2.2 Image Graph Initialization 165
10.2.3 Semantic Region Growing 167
10.3 Using Contextual Knowledge to Aid Visual Analysis 170
10.3.1 Contextual Knowledge Formulation 170
10.3.2 Contextual Relevance 173
10.4 Spatial Context and Optimization 177
10.4.1 Introduction 177
10.4.2 Low-Level Visual Information Processing 177
10.4.3 Initial Region-Concept Association 178
10.4.4 Final Region-Concept Association 179
10.5 Conclusions 181
Contents ix
11 Reasoning for Multimedia Analysis 183
Nikolaos Simou, Giorgos Stoilos, Carsten Saathoff,
Jan Nemrava, Vojtëch Svátek, Petr Berka and Vassilis Tzouvaras
11.1 Fuzzy DL Reasoning 184
11.1.1 The Fuzzy DL f-SHLhf 184
11.1.2 The Tableaux Algorithm 185
11.1.3 The FiRE Fuzzy Reasoning Engine 187
11.2 Spatial Features for Image Region Labeling 192
11.2.1 Fuzzy Constraint Satisfaction Problems 192
11.2.2 Exploiting Spatial Features Using Fuzzy
Constraint Reasoning 193
11.3 Fuzzy Rule Based Reasoning Engine 196
11.4 Reasoning over Resources Complementary to Audiovisual Streams 201
12 Multi-Modal Analysis for Content Structuring
and Event Detection 205
Noel E. O Connor, David A. Sadlier, Bart Lehane,
Andrew Salway, Jan Nemrava and Paul Buitelaar
12.1 Moving Beyond Shots for Extracting Semantics 206
12.2 A Multi-Modal Approach 207
12.3 Case Studies 207
12.4 Case Study 1: Field Sports 208
12.4.1 Content Structuring 208
12.4.2 Concept Detection Leveraging Complementary
Text Sources 213
12.5 Case Study 2: Fictional Content 214
12.5.1 Content Structuring 215
12.5.2 Concept Detection Leveraging Audio Description 219
12.6 Conclusions and Future Work 221
13 Multimedia Annotation Tools 223
Carsten Saathoff, Krishna Chandramouli, Werner Bailer,
Peter Schallauer and Raphaël Troncy
13.1 State of the Art 224
13.2 SVAT: Professional Video Annotation 225
13.2.1 User Interface 225
13.2.2 Semantic Annotation 228
13.3 KAT: Semi-automatic, Semantic Annotation
of Multimedia Content 229
13.3.1 History 231
13.3.2 Architecture 232
13.3.3 Default Plugins 234
13.3.4 Using COMM as an Underlying Model: Issues and Solutions 234
73.5.5 Semi-automatic Annotation: An Example 237
13.4 Conclusions 239
x Contents
14 Information Organization Issues in Multimedia Retrieval Using
Low-Level Features 241
Frank Hopfgartner, Reede Ren, Thierry Urruty and Joemon M. Jose
14.1 Efficient Multimedia Indexing Structures 242
14.1.1 An Efficient Access Structure for Multimedia Data 243
14.1.2 Experimental Results 245
14.1.3 Conclusion 249
14.2 Feature Term Based Index 249
14.2.1 Feature Terms 250
14.2.2 Feature Term Distribution 251
14.2.3 Feature Term Extraction 252
14.2.4 Feature Dimension Selection 253
14.2.5 Collection Representation and Retrieval System 254
14.2.6 Experiment 256
14.2.7 Conclusion 258
14.3 Conclusion and Future Trends 259
Acknowledgement 259
15 The Role of Explicit Semantics in Search and Browsing 261
Michiel Hildebrand, Jacco van Ossenbruggen and Lynda Hardman
15.1 Basic Search Terminology 261
15.2 Analysis of Semantic Search 262
15.2.1 Query Construction 263
75.2.2 Search Algorithm 265
15.2.3 Presentation of Results 267
15.2.4 Survey Summary 269
15.3 Use Case A: Keyword Search in ClioPatria 270
15.3.1 Query Construction 270
75J.2 Search Algorithm 270
15.3.3 Result Visualization and Organization 273
15.4 Use Case B: Faceted Browsing in ClioPatria 274
15.4.1 Query Construction 274
¡5.4.2 Search Algorithm 276
15.4.3 Result Visualization and Organization Tib
15.5 Conclusions 277
16 Conclusion 279
Raphaël Troncy, Benoit Huet and Simon Schenk
References 281
Author Index 301
Subject Index 303
|
| any_adam_object | 1 |
| author | Troncy, Raphael |
| author_facet | Troncy, Raphael |
| author_role | aut |
| author_sort | Troncy, Raphael |
| author_variant | r t rt |
| building | Verbundindex |
| bvnumber | BV039738557 |
| callnumber-first | Q - Science |
| callnumber-label | QA76 |
| callnumber-raw | QA76.575 |
| callnumber-search | QA76.575 |
| callnumber-sort | QA 276.575 |
| callnumber-subject | QA - Mathematics |
| classification_rvk | ST 270 |
| ctrlnum | (OCoLC)764281519 (DE-599)BVBBV039738557 |
| dewey-full | 006.7 |
| dewey-hundreds | 000 - Computer science, information, general works |
| dewey-ones | 006 - Special computer methods |
| dewey-raw | 006.7 |
| dewey-search | 006.7 |
| dewey-sort | 16.7 |
| dewey-tens | 000 - Computer science, information, general works |
| discipline | Informatik |
| format | Book |
| fullrecord | <?xml version="1.0" encoding="UTF-8"?><collection xmlns="http://www.loc.gov/MARC21/slim"><record><leader>01880nam a2200505zc 4500</leader><controlfield tag="001">BV039738557</controlfield><controlfield tag="003">DE-604</controlfield><controlfield tag="005">20120326 </controlfield><controlfield tag="007">t|</controlfield><controlfield tag="008">111202s2011 xxua||| |||| 00||| eng d</controlfield><datafield tag="010" ind1=" " ind2=" "><subfield code="a">2011001669</subfield></datafield><datafield tag="020" ind1=" " ind2=" "><subfield code="a">9780470747001</subfield><subfield code="c">cloth</subfield><subfield code="9">978-0-470-74700-1</subfield></datafield><datafield tag="035" ind1=" " ind2=" "><subfield code="a">(OCoLC)764281519</subfield></datafield><datafield tag="035" ind1=" " ind2=" "><subfield code="a">(DE-599)BVBBV039738557</subfield></datafield><datafield tag="040" ind1=" " ind2=" "><subfield code="a">DE-604</subfield><subfield code="b">ger</subfield><subfield code="e">aacr</subfield></datafield><datafield tag="041" ind1="0" ind2=" "><subfield code="a">eng</subfield></datafield><datafield tag="044" ind1=" " ind2=" "><subfield code="a">xxu</subfield><subfield code="c">US</subfield></datafield><datafield tag="049" ind1=" " ind2=" "><subfield code="a">DE-355</subfield></datafield><datafield tag="050" ind1=" " ind2="0"><subfield code="a">QA76.575</subfield></datafield><datafield tag="082" ind1="0" ind2=" "><subfield code="a">006.7</subfield></datafield><datafield tag="084" ind1=" " ind2=" "><subfield code="a">ST 270</subfield><subfield code="0">(DE-625)143638:</subfield><subfield code="2">rvk</subfield></datafield><datafield tag="100" ind1="1" ind2=" "><subfield code="a">Troncy, Raphael</subfield><subfield code="e">Verfasser</subfield><subfield code="4">aut</subfield></datafield><datafield tag="245" ind1="1" ind2="0"><subfield code="a">Multimedia semantics</subfield><subfield code="b">metadata, analysis, and interaction</subfield><subfield code="c">Raphael Troncy ; Benoit Huet; Simon Schenk</subfield></datafield><datafield tag="264" ind1=" " ind2="1"><subfield code="a">Chichester, West Sussex, U.K.</subfield><subfield code="b">Wiley</subfield><subfield code="c">2011</subfield></datafield><datafield tag="300" ind1=" " ind2=" "><subfield code="a">X, 305 S.</subfield><subfield code="b">Ill.</subfield></datafield><datafield tag="336" ind1=" " ind2=" "><subfield code="b">txt</subfield><subfield code="2">rdacontent</subfield></datafield><datafield tag="337" ind1=" " ind2=" "><subfield code="b">n</subfield><subfield code="2">rdamedia</subfield></datafield><datafield tag="338" ind1=" " ind2=" "><subfield code="b">nc</subfield><subfield code="2">rdacarrier</subfield></datafield><datafield tag="500" ind1=" " ind2=" "><subfield code="a">Includes bibliographical references and index</subfield></datafield><datafield tag="650" ind1=" " ind2="4"><subfield code="a">Multimedia systems</subfield></datafield><datafield tag="650" ind1=" " ind2="4"><subfield code="a">Semantic computing</subfield></datafield><datafield tag="650" ind1=" " ind2="4"><subfield code="a">Information retrieval</subfield></datafield><datafield tag="650" ind1=" " ind2="4"><subfield code="a">Database searching</subfield></datafield><datafield tag="650" ind1=" " ind2="4"><subfield code="a">Metadata</subfield></datafield><datafield tag="650" ind1="0" ind2="7"><subfield code="a">Recherche</subfield><subfield code="0">(DE-588)4121560-6</subfield><subfield code="2">gnd</subfield><subfield code="9">rswk-swf</subfield></datafield><datafield tag="650" ind1="0" ind2="7"><subfield code="a">Information Retrieval</subfield><subfield code="0">(DE-588)4072803-1</subfield><subfield code="2">gnd</subfield><subfield code="9">rswk-swf</subfield></datafield><datafield tag="650" ind1="0" ind2="7"><subfield code="a">Semantisches Datenmodell</subfield><subfield code="0">(DE-588)4314515-2</subfield><subfield code="2">gnd</subfield><subfield code="9">rswk-swf</subfield></datafield><datafield tag="689" ind1="0" ind2="0"><subfield code="a">Semantisches Datenmodell</subfield><subfield code="0">(DE-588)4314515-2</subfield><subfield code="D">s</subfield></datafield><datafield tag="689" ind1="0" ind2="1"><subfield code="a">Information Retrieval</subfield><subfield code="0">(DE-588)4072803-1</subfield><subfield code="D">s</subfield></datafield><datafield tag="689" ind1="0" ind2="2"><subfield code="a">Recherche</subfield><subfield code="0">(DE-588)4121560-6</subfield><subfield code="D">s</subfield></datafield><datafield tag="689" ind1="0" ind2=" "><subfield code="5">DE-604</subfield></datafield><datafield tag="700" ind1="1" ind2=" "><subfield code="a">Huet, Benoit</subfield><subfield code="e">Sonstige</subfield><subfield code="4">oth</subfield></datafield><datafield tag="700" ind1="1" ind2=" "><subfield code="a">Schenk, Simon</subfield><subfield code="e">Sonstige</subfield><subfield code="4">oth</subfield></datafield><datafield tag="856" ind1="4" ind2="2"><subfield code="m">HBZ Datenaustausch</subfield><subfield code="q">application/pdf</subfield><subfield code="u">http://bvbr.bib-bvb.de:8991/F?func=service&doc_library=BVB01&local_base=BVB01&doc_number=024586284&sequence=000002&line_number=0001&func_code=DB_RECORDS&service_type=MEDIA</subfield><subfield code="3">Inhaltsverzeichnis</subfield></datafield><datafield tag="943" ind1="1" ind2=" "><subfield code="a">oai:aleph.bib-bvb.de:BVB01-024586284</subfield></datafield></record></collection> |
| id | DE-604.BV039738557 |
| illustrated | Illustrated |
| indexdate | 2024-12-20T16:01:12Z |
| institution | BVB |
| isbn | 9780470747001 |
| language | English |
| lccn | 2011001669 |
| oai_aleph_id | oai:aleph.bib-bvb.de:BVB01-024586284 |
| oclc_num | 764281519 |
| open_access_boolean | |
| owner | DE-355 DE-BY-UBR |
| owner_facet | DE-355 DE-BY-UBR |
| physical | X, 305 S. Ill. |
| publishDate | 2011 |
| publishDateSearch | 2011 |
| publishDateSort | 2011 |
| publisher | Wiley |
| record_format | marc |
| spellingShingle | Troncy, Raphael Multimedia semantics metadata, analysis, and interaction Multimedia systems Semantic computing Information retrieval Database searching Metadata Recherche (DE-588)4121560-6 gnd Information Retrieval (DE-588)4072803-1 gnd Semantisches Datenmodell (DE-588)4314515-2 gnd |
| subject_GND | (DE-588)4121560-6 (DE-588)4072803-1 (DE-588)4314515-2 |
| title | Multimedia semantics metadata, analysis, and interaction |
| title_auth | Multimedia semantics metadata, analysis, and interaction |
| title_exact_search | Multimedia semantics metadata, analysis, and interaction |
| title_full | Multimedia semantics metadata, analysis, and interaction Raphael Troncy ; Benoit Huet; Simon Schenk |
| title_fullStr | Multimedia semantics metadata, analysis, and interaction Raphael Troncy ; Benoit Huet; Simon Schenk |
| title_full_unstemmed | Multimedia semantics metadata, analysis, and interaction Raphael Troncy ; Benoit Huet; Simon Schenk |
| title_short | Multimedia semantics |
| title_sort | multimedia semantics metadata analysis and interaction |
| title_sub | metadata, analysis, and interaction |
| topic | Multimedia systems Semantic computing Information retrieval Database searching Metadata Recherche (DE-588)4121560-6 gnd Information Retrieval (DE-588)4072803-1 gnd Semantisches Datenmodell (DE-588)4314515-2 gnd |
| topic_facet | Multimedia systems Semantic computing Information retrieval Database searching Metadata Recherche Information Retrieval Semantisches Datenmodell |
| url | http://bvbr.bib-bvb.de:8991/F?func=service&doc_library=BVB01&local_base=BVB01&doc_number=024586284&sequence=000002&line_number=0001&func_code=DB_RECORDS&service_type=MEDIA |
| work_keys_str_mv | AT troncyraphael multimediasemanticsmetadataanalysisandinteraction AT huetbenoit multimediasemanticsmetadataanalysisandinteraction AT schenksimon multimediasemanticsmetadataanalysisandinteraction |