Lunarpedia talk:Autostub1 test 1
Revision as of 07:46, 10 July 2007 by Strangelv (talk | contribs) (→Source Code: upgraded to what should be the most recent version)
Erratum
- Category tag for 'Location' should have been 'Locations'
-- Strangelv 18:27, 4 November 2006 (PST)
Problems
- How to tie the satellite crater articles to the main crater articles when the USGS database doesn't link them?
- What is the area of each sector in km**2?
- How might the script determine if a given feature is in a given sector? If we treat each item as a perfect circle, how do we determine which sectors include portions of that circle?
- Can we automatically do maps for features near the poles?
-- Strangelv 18:13, 4 November 2006 (PST)
To Do
- Sector areas ---- I posted the solution to this Charles F. Radley 17:53, 16 January 2007 (PST)
- Match sectors and features (not just centers) -- easy to solve, will do on a weekend or snow day Charles F. Radley 17:53, 16 January 2007 (PST)
- Match satellite craters with their central craters - Where is the list of satellite craters? Charles F. Radley 17:53, 16 January 2007 (PST)
- I have the data downloaded, but I can't find the URL from the USGS page I got it from. -- Strangelv 18:38, 16 January 2007 (PST)
- Border case handling for when feature center is on the boundary of two or four sectors - What do you want it to do in those cases ? Charles F. Radley 17:53, 16 January 2007 (PST)
- Possibly list as included in all of the above? -- Strangelv 18:38, 16 January 2007 (PST)
- Automatically load and parse tab delimited CSV --- Is this done now ? Charles F. Radley 17:53, 16 January 2007 (PST)
- No. You may notice the hard-coded data entry in the script. 8) I basically cranked out the essentials to produce the test page and then got sidetracked as well as stopped by a few technical issues listed on this page. -- Strangelv 18:38, 16 January 2007 (PST)
- Automatically output articles in XML for bulk import
- Automatically generate map files for suitably large features
- Automatically generate sector articles and maps
-- Strangelv 18:13, 4 November 2006 (PST)
Bonus Points
Is there a public domain database of rille?- Are there other public domain databases of use that we might be able to merge into this to add details to sectors and features (such as surface samples)?
-- Strangelv 18:13, 4 November 2006 (PST)
The precise coordinates of the Apollo sites are available on the web link provided on that page. Charles F. Radley 17:50, 16 January 2007 (PST)
- Just need to add those to the database if they're not already there. I believe several features named on the ground are already in there. -- Strangelv 18:38, 16 January 2007 (PST)
- Is there a public domain database that represents non-circular features in a non-circular manner?
-- Strangelv 16:25, 27 December 2006 (PST)
How about approximating them to ellipses? Standard geometry equations. Charles F. Radley 17:49, 16 January 2007 (PST)
- Sounds great if it can be found. I've only seen one database though, and it treats everything as circles whether perfectly appropriate or wildly inappropriate. Manually changing them ourselves at this stage isn't feasible given the sheer number of features in the database. -- Strangelv 18:38, 16 January 2007 (PST)
Software Development Plan
Moved to Lunarpedia_talk:Autostub1#Software_Development_Plan
Source Code
Warning: Put in place with <PRE> tags, which change some formatting. Copy from the edit or view source page to get an accurate copy.
And yes, the code is really rough in a few places (like where reinventing the wheel is faster than remembering where the wheel is). The language is Python. 2.4 and later should work; earlier may require replacing my '//' division with integer coercion.
#%#%#%#%#%#%#%#%#%#%#%#%#%#%#%#
# #
# Autostub 1 #
# #
# Feature Autostub Generator #
# #
# Public Domain #
# #
#%#%#%#%#%#%#%#%#%#%#%#%#%#%#%#
def dofeature(thisentry):
"""Generates article on a feature given in thisentry
00 -- system (will always be 'Earth'
01 -- satellite (will always be Moon)
name 02 -- name
lat 03 -- USGS latitude
04 -- USGS longitude
me_long = poslong(thisentry[4]) -- Mean Earth longitude
mo_long = me2mo(me_long) -- Mare Orientale longitude
me_coord = coordstr(me_long, lat) -- string for Mean Earth coordinates
mo_coord = coordstr(mo_long, lat) -- string for Mare Orientale coordinates
05 -- starting latitude (never provided, unfortunately)
06 -- ending latitude (never provided, unfortunately)
07 -- starting longitude (never provided, unfortunately)
08 -- ending longitude (never provided, unfortunately)
09 -- DIR (???)
dia 10 -- diameter in klicks
11 -- CT (country of discovery?)
12 -- Continent (of discovery?)
13 -- ET (???)
14 -- Ethnicity (of name?)
15 -- Quad (USGS map info)
16 -- Map (USGS map info)
17 -- AS (???)
approvalStat 18 -- Approved Status Description
approvalYear 19 -- Approval Date (year)
20 -- REF (???)
reference 21 -- References
22 -- FT (Feature Type categorization, presumably)
featuretype 23 -- Feature Type Name
origin 24 -- origin
"""
#
# Set up variables to generate article stub
#
#%#%#%#%#%#%#%#%#%#%#%#%#%#%%#%#%#%#%#
#
name = thisentry[2] # name of feature
mapname = makemapname(name, None) # filename for this feature's
# automatically generated
# map from Clementine data
Lat = float(thisentry[3]) # USGS latitude
lat = do_lat(Lat) # string with proper latitude
me_long = poslong(thisentry[4]) # longitude (Mean Earth)
mo_long = me2mo(me_long) # longitude (Mare Orientale)
me_coord = coordstr(me_long, lat) # Mean Earth coordinate string
mo_coord = coordstr(mo_long, lat) # Mare Orientale coordinate string
origin = thisentry[24] # 'Origin' column in database
# warning: this seems to
# be almost anything
featuretype = thisentry[23] # Is this a mare, a crater, other?
dia = thisentry[10] # feature diameter, if applicable
approvalStat = thisentry[18] # year approval information
approvalYear = thisentry[19] # year of approval (if approved)
reference = thisentry[21] # 'reference' column in database
inSector = isinsector(mo_long, Lat) # what sector is this feature
# centered in?
sectors = sectorlist(mo_long, lat, dia)
# -----what sectors include it?
typecat = dotypecat(featuretype) # simplified category type
domap(mapname, mo_long, lat, dia) # create the map
localeDescr = descrlocale(mo_long, Lat, typecat)
# -----text description of location
approvalStr = doapproval(approvalStat, approvalYear)
# -----text description of approval,
# if approved.
#%#%#%#%#%#%#%#%#%#%#%#%#%#%%#%#%#%#%#
#
# start generating the article here:
#
to_out = []
to_out += ["{{Circular Feature "]
to_out += ["name = "+name]
to_out += ["featuretype = "+typecat]
to_out += ["origin = "+origin]
to_out += ["map = [[Image:"+mapname+"|240px]]"]
to_out += ["mo_coord = "+mo_coord]
to_out += ["me_coord = "+me_coord]
to_out += ["dia = "+dia]
to_out += ["approval = "+approvalStr]
# Tidily install pipes for the table
to_out = tidypipes(to_out)
to_out += ["}}"]
to_out += ["'''"+name+"''' "+localeDescr]
to_out += ["<BR/><BR/>\n\n"]
# if inSector !="AAAAAAAAA!":
to_out += ["The center of "+name+" is in sector [[Sector_"+inSector+"]]"]
# else:
# inSectors = something()
to_out += ["<BR/><BR/>\n\n"]
to_out += ["==See Also=="]
for q in sectors:
to_out += ["[["+q+"]]"]
to_out += ["<BR/><BR/>\n\n"]
to_out += ["==References=="]
to_out += [refbreak(reference)]
to_out += ["{{Autostub}}"]
# to_out += ["[[Category:Locations]]"]
to_out += docategories(typecat) #["[[Category:"+typecat+"]]"]
to_out += ["<!-- Generated by a too-early version of WikiMess Autostub1 -->"]
return to_out
# def main():
# # load database
# didxml = templatetop()
# for q in database: didxml += dostub(q) + templatemid(); print ".",
# didxml += templatefin()
# # save didxml
def makemapname(name, other):
"""
"""
name2=""
for q in name:
if q == " ": name2 += "_"
else: name2 += q
if other: name2 += "_"+other
name2 += ".png"
return name2
def poslong(long_):
"""convert string of possibly noncompliant Mean Earth longitude into float or fixed of compliant Mean Earth longitude
"""
long_ = float(long_)
if long_ < 0 : long_ += 360
return long_
def me2mo(me_long):
"""
"""
mo_long=float(me_long)-267.2
if mo_long <0: mo_long += 360.0
#print "me_long == "+str(me_long)
return mo_long
def coordstr(long_,lat):
""" temporary implementation
"""
return str(lat)+" "+str(long_)
def descrlocale(long_, lat, what):
"""quickie hack
"""
if lat > 5: vert = "a northern"
elif lat < 5: vert = "a southern"
else: vert = "an equatorial"
if long_ <= 165 and long_ >= 15: side = "near side"
elif long_ <= 195 and long_ >= 345: side = "far side"
elif long_ >= 165 and long_ <= 195: side = "east edge"
else: side = "west edge"
return "is "+vert+" "+what+" on the "+side+" of Luna."
def isinsector(long_,lat):
"""can we determinewhat sector you're in?
"""
# special case handling?
def AAAAAAAAA():
# border case handling
return "AAAAAAAAA!"
# find latitude part or bust
if lat == 0.0: LT="E" # this is equatorial
else:
if lat > 0: LTH = "N"
else:
lat = -lat
LTH = "S"
if ((lat+7.5)//15) == ((lat+7.5)/15.0): return AAAAAAAAA()
LT = str(int(((lat+7.5)//15)*15)) + LTH
if LT == "90": return LTH # this is a polar sector
# find longitude part or bust
if long_ < 7.5 or long_ > 352.5: LG = "000" # prime meridian sector
else:
if ((long_+7.5)//15) == ((long_+7.5)/15.0): return AAAAAAAAA()
LG = str(int(((long_+7.5)//15)*15))
if len(LG)<3: LG = "0"+LG
# return the result!
return LT+LG
def dotypecat(stringie):
"""
"""
if stringie == "Rima, rimae": return "rima"
# Most definitely need to list the complete set
return stringie
def docategories(typecat):
if typecat == "rima": return ["[[Category:Rima]]","[[Category:Locations]]"]
return [typecat]
def sectorlist(long_,lat,dia):
"""
"""
return ["sectorlist() not implemented"]
def domap(mapname,long_,lat,dia):
"""
"""
return "domap() not implemented"
def doapproval(approvalStat, approvalYear):
"""temporary hack; needs to acconut for unapproved
"""
return approvalStat+" in "+approvalYear
def tidypipes(table):
"""takes a list oy strings, finds the longest one, and tidily adds pipes to the right of each line.
maxlen: maximum length
table: input list of strings
table2: output list of strings
"""
maxlen = 0
for q in table:
if len(q)>maxlen: maxlen = len(q)
table2 = []
for q in table:
qq = q
while (len(qq)<maxlen):
qq += " "
table2 += [qq+" |"]
return table2
def do_lat(lat):
"""returns string for latitude
"""
if lat > 0: return str(lat)+"N"
if lat == 0: return "E"
return str(-lat)+"S"
def replacer(stringie, old, new):
"""
"""
name2=""
for q in stringie:
if q == old: name2 += new
else: name2 += q
return name2
def refbreak(ref):
"""
"""
return replacer(ref,";",";<BR/>")
##def ():
## """
## """
## return "() not implemented"
##
##def ():
## """
## """
## return "() not implemented"
def Stringify(listish):
stringish = ""
for q in listish:
if type(q) == type('str'):
stringish += q
#print "str"
elif type(q) == type([]):
stringish += Stringify(q)
#print "list"
else:
print type(q)
print q
raise TypeError, "non-string non-list!!!"
return stringish
def TSVinput(filename):
"""tab separated database parser
"""
# Open filename
tsv=open(filename)
# Convert to list
## get list of lines
biglist = tsv.readlines()
#for q in tsv:
# biglist += q
tsv.close()
## parse lines
#for q in biglist: print q
newlist = []
for q in biglist:
newlist += [q.split("\t")]
# print max(max(newlist))
# return list
return newlist
def StartXML():
out = [['<mediawiki xmlns="http://www.mediawiki.org/xml/export-0.3/" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" xsi:schemaLocation="http://www.mediawiki.org/xml/export-0.3/ http://www.mediawiki.org/xml/export-0.3.xsd" version="0.3" xml:lang="en">\n']]
out += [' <siteinfo>\n']
out += [' <sitename>Lunarpedia</sitename>\n']
out += [' </siteinfo>\n']
return out
def EndXML():
out = [['</mediawiki>\n']]
return out
def ArtXML(title, contrib, text):
'''XML markup for article in file
title -- title of article
contrib -- name of script (ie Autostub2)
text -- the article
'''
out = [[' <page>\n']]
out += [' <title>'+title+'</title>\n']
out += [' <revision>\n']
out += [' <contributor>\n']
out += [' <username>'+contrib+'</username>\n']
out += [' </contributor>\n']
# out += [' <text xml:space="preserve">'+text+'</text>']
out += [' <text xml:space="preserve">']
out += text
out += ['</text>\n']
out += [' </revision>\n']
out += [' </page>\n']
#Item = ["Earth","Moon","Rima Diophantus","29.0","-33.0"," "," "," "," ","east","150.0","EU","Europe","GR","Greek","LTO39B2","LTO-39B2","5","Adopted by IAU","1985","0","null","RI","Rima, rimae","Named from nearby crater."]
Item = ["Earth","Moon","Rima Cardanus","11.4","-71.5"," "," "," "," ","east","175.0","EU","Europe","IT","Italy","LOC-1","LOC-1","5","Adopted by IAU","1964","67","The System of Lunar Craters, Quadrants I, II, III, IV; by D. W. G. Arthur and others; Communications of the Lunar and Planetary Laboratory, vol. 2, no. 30, 1963; vol. 3, no. 40, 1964; vol. 3, no. 50, 1965; vol. 5, no. 70, 1966.","RI","Rima, rimae","Named from nearby crater."]
What=dofeature(Item)
for q in What: print q
