Difference between revisions of "Data Preparation Procedures"

From Wikibase.slis.ua.edu
Jump to navigation Jump to search
Line 12: Line 12:
 
=== PROCEDURES ===
 
=== PROCEDURES ===
  
Spreadsheet preparation procedures - downloading/acquiring and then preparing spreadsheets based on time period within which each game occurred
+
Spreadsheet preparation procedures - downloading/acquiring and then preparing spreadsheets based on time period within which each game occurred. Procedures include data cleaning and uploading cleaned data to our Wikibase instance using our QuickStatements tool.
  
 
==== Category 1 Games ====
 
==== Category 1 Games ====
  
Football games in this category span the 2001 to present time period and have JSON-encoded play-by-play data sources. This category further subdivides based on the availability of wall clock data for each play (2014 to present).
+
Football games in this category occurred 2001 to present and have JSON-encoded play-by-play data sources. This category further subdivides based on the availability of wall clock data for each play (games occurring 2014 to present).
  
 +
# Games 2014 to present:
 
## '''[[Preparing Spreadsheets for Games 2014 to Present]]''' (with wall clock data)
 
## '''[[Preparing Spreadsheets for Games 2014 to Present]]''' (with wall clock data)
 +
## '''[[Preparing Drive Creation Spreadsheets for Games 2014 to Present]]'''
 +
## '''[[Preparing Drive Data Spreadsheets for Games 2014 to Present]]'''
 +
## '''[[Preparing Play Creation Spreadsheets for Games 2014 to Present]]'''
 +
## '''[[Preparing Play-by-play Data Spreadsheets for Games 2014 to Present]]'''
 +
## Further preparation procedures to following, including for player participation data
 +
# Games 2001 to present:
 
## '''[[Preparing Spreadsheets for Games 2001 to 2013]]''' (no wall clock data)
 
## '''[[Preparing Spreadsheets for Games 2001 to 2013]]''' (no wall clock data)
 +
## '''[[Preparing Drive Creation Spreadsheets for Games 2001 to 2013]]'''
 +
## '''[[Preparing Drive Data Spreadsheets for Games 2001 to 2013]]'''
 +
## '''[[Preparing Play Creation Spreadsheets for Games 2001 to 2013]]'''
 +
## '''[[Preparing Play-by-play Data Spreadsheets for Games 2001 to 2013]]'''
 +
 
## '''[[Preparing Spreadsheets for Transcribed Games]]''' (that is, games with transcribed play-by-play data sources)
 
## '''[[Preparing Spreadsheets for Transcribed Games]]''' (that is, games with transcribed play-by-play data sources)
 
## '''[[Preparing Spreadsheets for Historical Games]]''' (that is, games without play-by-play data sources)
 
## '''[[Preparing Spreadsheets for Historical Games]]''' (that is, games without play-by-play data sources)
 
# Drive data preparation and upload procedures
 
# Drive data preparation and upload procedures
 
## Drive creation
 
## Drive creation
### '''[[Preparing Drive Creation Spreadsheets for Games 2014 to Present]]'''
+
#
### '''[[Preparing Drive Creation Spreadsheets for Games 2001 to 2013]]'''
+
#
 
### '''[[Preparing Drive Creation Spreadsheets for Transcribed Games]]'''
 
### '''[[Preparing Drive Creation Spreadsheets for Transcribed Games]]'''
 
### '''[[Preparing Drive Creation Spreadsheets for Historical Games]]'''
 
### '''[[Preparing Drive Creation Spreadsheets for Historical Games]]'''
 
## Drive data
 
## Drive data
### '''[[Preparing Drive Data Spreadsheets for Games 2014 to Present]]'''
+
#
### '''[[Preparing Drive Data Spreadsheets for Games 2001 to 2013]]'''
+
#
 
### '''[[Preparing Drive Data Spreadsheets for Transcribed Games]]'''
 
### '''[[Preparing Drive Data Spreadsheets for Transcribed Games]]'''
 
### '''[[Preparing Drive Data Spreadsheets for Historical Games]]'''
 
### '''[[Preparing Drive Data Spreadsheets for Historical Games]]'''
 
# Play-by-play data preparation and upload procedures
 
# Play-by-play data preparation and upload procedures
 
## Play creation
 
## Play creation
### '''[[Preparing Play Creation Spreadsheets for Games 2014 to Present]]'''
+
#
### '''[[Preparing Play Creation Spreadsheets for Games 2001 to 2013]]'''
+
#
 
### '''[[Preparing Play Creation Spreadsheets for Transcribed Games]]'''
 
### '''[[Preparing Play Creation Spreadsheets for Transcribed Games]]'''
 
### '''[[Preparing Play Creation Spreadsheets for Historical Games]]'''
 
### '''[[Preparing Play Creation Spreadsheets for Historical Games]]'''
 
## Play-by-play data
 
## Play-by-play data
### '''[[Preparing Play-by-play Data Spreadsheets for Games 2014 to Present]]'''
+
#
### '''[[Preparing Play-by-play Data Spreadsheets for Games 2001 to 2013]]'''
+
#
 
### '''[[Preparing Play-by-play Data Spreadsheets for Transcribed Games]]'''
 
### '''[[Preparing Play-by-play Data Spreadsheets for Transcribed Games]]'''
 
### '''[[Preparing Play-by-play Data Spreadsheets for Historical Games]]'''
 
### '''[[Preparing Play-by-play Data Spreadsheets for Historical Games]]'''

Revision as of 14:58, 21 December 2018

This page provides information on data preparation for using QuickStatement.

Procedures vary based on the year that a game occurred.

IMPORTANT: Before creating an Item page, be to to search to be sure it doesn't already exist!

PRELIMINARY STEPS

  1. Make sure a season page exists for each team participating in the game: Indexing a Football Team Season
  2. Creating an item page for a game: Indexing a Football Game


PROCEDURES

Spreadsheet preparation procedures - downloading/acquiring and then preparing spreadsheets based on time period within which each game occurred. Procedures include data cleaning and uploading cleaned data to our Wikibase instance using our QuickStatements tool.

Category 1 Games

Football games in this category occurred 2001 to present and have JSON-encoded play-by-play data sources. This category further subdivides based on the availability of wall clock data for each play (games occurring 2014 to present).

  1. Games 2014 to present:
    1. Preparing Spreadsheets for Games 2014 to Present (with wall clock data)
    2. Preparing Drive Creation Spreadsheets for Games 2014 to Present
    3. Preparing Drive Data Spreadsheets for Games 2014 to Present
    4. Preparing Play Creation Spreadsheets for Games 2014 to Present
    5. Preparing Play-by-play Data Spreadsheets for Games 2014 to Present
    6. Further preparation procedures to following, including for player participation data
  2. Games 2001 to present:
    1. Preparing Spreadsheets for Games 2001 to 2013 (no wall clock data)
    2. Preparing Drive Creation Spreadsheets for Games 2001 to 2013
    3. Preparing Drive Data Spreadsheets for Games 2001 to 2013
    4. Preparing Play Creation Spreadsheets for Games 2001 to 2013
    5. Preparing Play-by-play Data Spreadsheets for Games 2001 to 2013
    1. Preparing Spreadsheets for Transcribed Games (that is, games with transcribed play-by-play data sources)
    2. Preparing Spreadsheets for Historical Games (that is, games without play-by-play data sources)
  1. Drive data preparation and upload procedures
    1. Drive creation
      1. Preparing Drive Creation Spreadsheets for Transcribed Games
      2. Preparing Drive Creation Spreadsheets for Historical Games
    1. Drive data
      1. Preparing Drive Data Spreadsheets for Transcribed Games
      2. Preparing Drive Data Spreadsheets for Historical Games
  2. Play-by-play data preparation and upload procedures
    1. Play creation
      1. Preparing Play Creation Spreadsheets for Transcribed Games
      2. Preparing Play Creation Spreadsheets for Historical Games
    1. Play-by-play data
      1. Preparing Play-by-play Data Spreadsheets for Transcribed Games
      2. Preparing Play-by-play Data Spreadsheets for Historical Games

Data prep required for creating and populate each drive's item page using QuickStatements... two steps process:

    1. Create spreadsheet that will derive Q numbers for each drive and incorporating "instance of" statements: Drive Creation Procedure
    2. Create spreadsheet to populate data about each drive's (now) existing item page: Drive Data Preparation
  1. Play-by-play Data Preparation and Upload Procedures