Analyse von Beurteilungen räumlicher Objekte in natürlich sprachlichen Texten Sarah Tauscher, Karl Neumann

Transkript

1 Analyse von Beurteilungen räumlicher Objekte in natürlich sprachlichen Texten Sarah Tauscher, Karl Neumann Institut für Informationssysteme Technische Universität Braunschweig

2 Example: Main Tower Main Tower by antistar Updated Apr 28, 2012 Frankfurt's skyscraper scene is very impressive, and Frankfurt is the only city in Europe that allows the construction of such monsters directly in the city center. This gives Frankfurt a uniquely foreign feeling, and it often looks more like it should be a city in Australia, America or the Far East, than your typical German city. Underneath the skyscrapers, Frankfurt is your typical German city, and the juxtaposition of the old buildings in the Altstadt with the shining modern glass and steel structures tearing up into the sky makes for some great photographs. Unfortunately only one of the city center towers is open to the public, but thankfully it is a tall one. At one shy of 200 meters, the Main Tower (Mainturm) is the fourth tallest building in the city, and its viewing platform allows for some astonishing views. From the Mainturm you can see the Europaturm ("The Asparagus of Ginnheim"), which if not for aerials would be the tallest structure in Germany. You are also placed right next to the Commerzbank Tower, which is currently the tallest building in the EU. Quelle: Thomas Wolf, 2

3 Example: Main Tower Main Tower by antistar Updated Apr 28, 2012 Frankfurt's skyscraper scene is very impressive, and Frankfurt is the only city in Europe that allows the construction of such monsters directly in the city center. This gives Frankfurt a uniquely foreign feeling, and it often looks more like it should be a city in Australia, America or the Far East, than your typical German city. Underneath the skyscrapers, Frankfurt is your typical German city, and the juxtaposition of the old buildings in the Altstadt with the shining modern glass and steel structures tearing up into the sky makes for some great photographs. Unfortunately only one of the city center towers is open to the public, but thankfully it is a tall one. At one shy of 200 meters, the Main Tower (Mainturm) is the fourth tallest building in the city, and its viewing platform allows for some astonishing views. From the Mainturm you can see the Europaturm ("The Asparagus of Ginnheim"), which if not for aerials would be the tallest structure in Germany. You are also placed right next to the Commerzbank Tower, which is currently the tallest building in the EU. Quelle: Thomas Wolf, 3

4 Example: Main Tower Main Tower by antistar Updated Apr 28, 2012 Frankfurt's skyscraper scene is very impressive, and Frankfurt is the only city in Europe that allows the construction of such monsters directly in the city center. This gives Frankfurt a uniquely foreign feeling, and it often looks more like it should be a city in Australia, America or the Far East, than your typical German city. Underneath the skyscrapers, Frankfurt is your typical German city, and the juxtaposition of the old buildings in the Altstadt with the shining modern glass and steel structures tearing up into the sky makes for some great photographs. Unfortunately only one of the city center towers is open to the public, but thankfully it is a tall one. At one shy of 200 meters, the Main Tower (Mainturm) is the fourth tallest building in the city, and its viewing platform allows for some astonishing views. From the Mainturm you can see the Europaturm ("The Asparagus of Ginnheim"), which if not for aerials would be the tallest structure in Germany. You are also placed right next to the Commerzbank Tower, which is currently the tallest building in the EU. Quelle: Thomas Wolf, 4

5 Example: Main Tower Main Tower by antistar Updated Apr 28, 2012 Frankfurt's skyscraper scene is very impressive, and Frankfurt is the only city in Europe that allows the construction of such monsters directly in the city center. This gives Frankfurt a uniquely foreign feeling, and it often looks more like it should be a city in Australia, America or the Far East, than your typical German city. Underneath the skyscrapers, Frankfurt is your typical German city, and the juxtaposition of the old buildings in the Altstadt with the shining modern glass and steel structures tearing up into the sky makes for some great photographs. Unfortunately only one of the city center towers is open to the public, but thankfully it is a tall one. At one shy of 200 meters, the Main Tower (Mainturm) is the fourth tallest building in the city, and its viewing platform allows for some astonishing views. From the Mainturm you can see the Europaturm ("The Asparagus of Ginnheim"), which if not for aerials would be the tallest structure in Germany. You are also placed right next to the Commerzbank Tower, which is currently the tallest building in the EU. Quelle: Thomas Wolf, 5

6 Example: Main Tower Main Tower by antistar Updated Apr 28, 2012 Frankfurt's skyscraper scene is very impressive, and Frankfurt is the only city in Europe that allows the construction of such monsters directly in the city center. This gives Frankfurt a uniquely foreign feeling, and it often looks more like it should be a city in Australia, America or the Far East, than your typical German city. Underneath the skyscrapers, Frankfurt is your typical German city, and the juxtaposition of the old buildings in the Altstadt with the shining modern glass and steel structures tearing up into the sky makes for some great photographs. Unfortunately only one of the city center towers is open to the public, but thankfully it is a tall one. At one shy of 200 meters, the Main Tower (Mainturm) is the fourth tallest building in the city, and its viewing platform allows for some astonishing views. From the Mainturm you can see the Europaturm ("The Asparagus of Ginnheim"), which if not for aerials would be the tallest structure in Germany. You are also placed right next to the Commerzbank Tower, which is currently the tallest building in the EU. Quelle: Thomas Wolf, 6

7 Example: Main Tower Main Tower by antistar Updated Apr 28, 2012 Frankfurt's skyscraper scene is very impressive, and Frankfurt is the only city in Europe that allows the construction of such monsters directly in the city center. This gives Frankfurt a uniquely foreign feeling, and it often looks more like it should be a city in Australia, America or the Far East, than your typical German city. Underneath the skyscrapers, Frankfurt is your typical German city, and the juxtaposition of the old buildings in the Altstadt with the shining modern glass and steel structures tearing up into the sky makes for some great photographs. Unfortunately only one of the city center towers is open to the public, but thankfully it is a tall one. At one shy of 200 meters, the Main Tower (Mainturm) is the fourth tallest building in the city, and its viewing platform allows for some astonishing views. From the Mainturm you can see the Europaturm ("The Asparagus of Ginnheim"), which if not for aerials would be the tallest structure in Germany. You are also placed right next to the Commerzbank Tower, which is currently the tallest building in the EU. Quelle: Thomas Wolf, 7

8 Example: Main Tower Main Tower by antistar Updated Apr 28, 2012 Frankfurt's skyscraper scene is very impressive, and Frankfurt is the only city in Europe that allows the construction of such monsters directly in the city center. This gives Frankfurt a uniquely foreign feeling, and it often looks more like it should be a city in Australia, America or the Far East, than your typical German city. Underneath the skyscrapers, Frankfurt is your typical German city, and the juxtaposition of the old buildings in the Altstadt with the shining modern glass and steel structures tearing up into the sky makes for some great photographs. Unfortunately only one of the city center towers is open to the public, but thankfully it is a tall one. At one shy of 200 meters, the Main Tower (Mainturm) is the fourth tallest building in the city, and its viewing platform allows for some astonishing views. From the Mainturm you can see the Europaturm ("The Asparagus of Ginnheim"), which if not for aerials would be the tallest structure in Germany. You are also placed right next to the Commerzbank Tower, which is currently the tallest building in the EU. Quelle: Thomas Wolf, 8

9 Textanalysis: Stanford CoreNLP Natural Language Processing Group der Stanford University Bestehend aus Linguisten und Informatikern Stanford CoreNLP umfasst eine Menge von Tools zur Analyse von natürlich sprachlichen Texten Ziel ist es Menschen schnell und einfach zu kompletten linguistischen Annotationen zu verhelfen flexibel und erweiterbar Open Source Geschrieben in Java and lizenziert unter der GNU General Public License 9

10 Part of Speech Tagger Ein maximum- entropy-based Part of Speech Tagger Erlernt ein loglineares conditional probability model mit Hilfe von getaggten Text Verwendung zusätzlicher Informationen Großschreibung bei unbekannten Wörtern Für die Unterscheidung von Verbzeitformen Für die Unterscheidung von Präpositionen und Adverben Korrektheit: 96.86% insgesamt, 86.91% bei unbekannten Worten(Penn Treebank ) Visualisation provided using the brat visualisation/annotation software. Copyright 2011, Stanford University 10

11 Named Entity Recognition Heuristisches Verfahren zur Erkennung von benannten Entitäten (Gibbs sampling) Zuordnung zu 7 Gruppen 11

12 Gazetteer aus OSM-Daten Idee: Orte über die Reszensionen verfasst werden, werden wahrscheinlich auch in OSM erfasst OSM enthält Namen in verschiedenen Sprachen und auch veraltete Versionen Semantische Informationen sind in Tags enthalten Keine Objektarten Tags sind nicht einheitlich Tags sind nicht vollständig 12

13 Gazetteer aus OSM-Daten Annahme: Alle notwendigen Informationen sind vorhanden Identifizierung von objektbildenden Tags Beschränkung auf Objekte mit Name-Tag Iteratives Verfahren Identifizierung der Objekte mit nur einem relevanten Tag Bildung von Gruppen aller Objekte mit diesem Tag Kennzeichnung der Tags die in mehreren Gruppen verwendet werden als irrelevant Verwenden von Tags deren Schlüssel mehrheitlich Gruppen identifiziert zur Klassifizierung der verbliebenen Objekte 13

14 OSM Daten für Braunschweig Objekte 932 benannte Objekte Mit 2 bis 33 Tags Median 5 Tags Tags 181 unterschiedliche Schlüssel mit 1 bis 636 verschiedenen Werten Median 2 Werte 14

15 Objektklassen für Braunschweig Ergebnis 65 Objektklassen nach 5 Iterationen 24 weitere Objektklassen nach Nachbearbeitung 11 unklassifizierte Objekte, davon 7 auch manuell nicht an Hand von Tags klassifizierbar Sinnvolle Klassen, keine Fehlzuordnungen Teils unterschiedliche Abstraktionsebenen Tourism:Artwork vs shop:books Nächste Schritte Zusammenfassung von Klassen (hierarchische Klassifizierung) Aufteilung von Klassen 15

16 Coreference Resolution Deterministisches Verfahren Maschinelle Lernverfahren Regelbasiert Entitäts basiertes Modell Zwei Phasen Identifizierung von Vorkommen von Entitäten Bestimmen von Koreferenzen in 10 Schritten z.b. NameSpeaker Identification Sieve Exact String Match Sieve Relaxed String Match Sieve Pronoun Resolution Sieve 16

17 Example: Main Tower Main Tower by antistar Updated Apr 28, 2012 Frankfurt's skyscraper scene is very impressive, and Frankfurt is the only city in Europe that allows the construction of such monsters directly in the city center. This gives Frankfurt a uniquely foreign feeling, and it often looks more like it should be a city in Australia, America or the Far East, than your typical German city. Underneath the skyscrapers, Frankfurt is your typical German city, and the juxtaposition of the old buildings in the Altstadt with the shining modern glass and steel structures tearing up into the sky makes for some great photographs. Unfortunately only one of the city center towers is open to the public, but thankfully it is a tall one. At one shy of 200 meters, the Main Tower (Mainturm) is the fourth tallest building in the city, and its viewing platform allows for some astonishing views. From the Mainturm you can see the Europaturm ("The Asparagus of Ginnheim"), which if not for aerials would be the tallest structure in Germany. You are also placed right next to the Commerzbank Tower, which is currently the tallest building in the EU. Quelle: Thomas Wolf, 17

18 Fazit Verwendung von CoreNLP sinnvoll Gute Ergebnisse beim Part of Speech Tagger Probleme insbesondere bei der Named Entity Recgnition Einbindung eines Gazeetters Coreference Resolution mittelmäßige Ergebnisse Bessere Ergebnisse durch verbesserte Named Entity Recognition Ausnutzung des Review Titels OSM basierter Gazetteer Erste Ergebnisse vielversprechend Weitere Testdaten notwendig Verwenden von Wahrscheinlichkeiten für eine bessere Fehlertoleranz 18