26

For most popular tags, it would seem that there is a single obvious Wikipedia article or section of an article that could represent it. In the spirit of linked data, it would make sense to have a mapping from Stack Overflow tags to Wikipedia or Wikidata entities.

For example, the top 10 tags unambiguously map to:

Tag           | Wikipedia article                | Wikidata entity
------------- | -------------------------------- | ---------------
java          | Java_(programming_language)      | Q251
c#            | C_Sharp_(programming_language)   | Q2370
javascript    | JavaScript                       | Q2005
php           | PHP                              | Q59
android       | Android_(operating_system)       | Q94
jquery        | jQuery                           | Q230036
python        | Python_(programming_language)    | Q28865
html          | HTML                             | Q8811
c++           | C++                              | Q2407
mysql         | MySQL                            | Q850

Does a mapping for at least the the few thousand most popular tags exist already in a manner that is easy to access programmatically? If it doesn't yet exist but people see the need, should it be a part of Stack Overflow itself, or should it be hosted externally? Would it make sense to build a similar mapping for other sites in the Stack Exchange network?

Potential applications:

  • Automatically constructing lists of tags related by certain properties (ex. functional languages, operating systems, etc.) derived from Wikidata/Wikipedia properties/categories
  • Suggesting tags for questions based on the text similarity to Wikipedia articles, or based on explicit links to Wikipedia in the question
  • If this is done with other Stack Exchange sites, automatically linking to corresponding tags on different sites, without relying on constructing a mesh of inter-site links or enforcing the same tag names (ex., there is a "statistics" tag on stackoverflow, datascience.se, math.se, and physics.se, but mathoverflow and cstheory.se call the same concept "st.statistics")
11
  • 9
    What do you plan to do with such a mapping? That will determine whether anyone bothers to compile one. Sep 8, 2014 at 2:48
  • I would think it would be generically useful, but my immediate need is I want to categorize tags based on Wikidata properties/Wikipedia categories; for example, this automatically generated list has all the things Wikidata knows are programming languages. Another cool use is that you could automatically translate tag names into other languages.
    – bskaggs
    Sep 8, 2014 at 3:18
  • This might also get some needed overhauling on the ECMAScript articles that are sorely out of date (and I don't have the time to make the full re-writes).
    – Claudia
    Sep 9, 2014 at 2:30
  • 2
    It would make sense to build a mapping system if there was a use for the data that it gathers. Taking a looking at the data for Java, I can see its developer, what its named after, and other information. What I can't see is how this data can be useful in improving stackoverflow. Can you elaborate the ways in which the data can be Incorporated into StackOverflow? Like, are you suggesting that this data could be used to improve the tag wiki?
    – Dave Chen
    Sep 9, 2014 at 3:07
  • 1
    This website is for professionals and enthusiasts, I don't see what an established programmer would gain from reading a wikipedia entry rather than the correct documentation (which from the tags I have seen is normally linked)
    – Sayse
    Sep 9, 2014 at 8:33
  • 5
    That would be a great question for opendata.stackexchange.com Sep 9, 2014 at 9:20
  • 1
    @DaveChen: Having this data would let you use category information from Wikipedia/Wikidata and apply it to browsing and grouping tags. For example, it would be nice, if you cared about functional programming, to look at all questions for all languages that are in the "functional languages" category on Wikipedia, rather than relying on every one of them having the "functional-programming" tag.
    – bskaggs
    Sep 9, 2014 at 13:40
  • @NicolasRaoul: Great idea! I will post it there.
    – bskaggs
    Sep 9, 2014 at 13:42
  • @bskaggs So you're proposing that tags on Stackoverflow be grouped? It's an interesting idea, but most people have a set of tags that they are comfortable with, so adding a system to group tags doesn't seem necessary. Can you provide some examples within your question on how this data can be applied to SO?
    – Dave Chen
    Sep 9, 2014 at 20:27
  • @DaveChen: I edited the question with some example applications.
    – bskaggs
    Sep 9, 2014 at 21:20
  • Such a mapping would help in text annotation, tag translation, suggestions. This idea is good! It could be useful on both sides, SO and WP. Sep 10, 2014 at 13:39

1 Answer 1

18

Final Update (16 October 2014): Property P1482 on WikiData now contains these links for more than 1700 entities. If there is something missing, add it on WikiData!

Original Answer: I started building a Google spreadsheet with the list of all tags used at least once. Anyone can edit it and add new links to Wikipedia.

Edit: Getting sick of manual labor, I went through the May 2014 dump and pulled out any links to Wikipedia. I then used the Wikipedia API to normalize names and follow redirects. I've got the results as a gist on Github. I will merge these into the above spreadsheet.

Edit 2: Following some suggestions on the Open Data Stack Exchange site, and after some discussion on WikiData, I've proposed "Stack Exchange tag" as a new property, so hopefully we will be able to soon store the data on WikiData itself.

Edit 3 (23 September 2014): Success! Property P1482 was created on WikiData to hold "Stack Exchange tag" URLs. I will be uploading what I currently have soon.

Edit 4 (25 September 2014): I created a bot on WikiData, and am seeking permission there to do the upload in bulk. In the meantime, I asked a question over at meta.stackexchange.com to see if I can publish the extracted information under the CC0 license that WikiData uses.

2
  • Because of "the spirit of linked data", you might want to use DBpedia instead of Wikipedia.
    – unor
    Sep 9, 2014 at 9:51
  • 2
    @unor: Since most of the popular tags have Wikipedia links, and many link to subsections of articles, it's easiest for me to use Wikipedia as my anchor. But, after that, it should be easy to pull through to DBpedia via Wikipedia.
    – bskaggs
    Sep 9, 2014 at 14:04

You must log in to answer this question.

Not the answer you're looking for? Browse other questions tagged .