譌･譛ｬ縺ｮ莨第律
==========
Thunderbird縺ｪ縺ｩ縺ｮ繧ｫ繝ｬ繝ｳ繝繝ｼ縺ｫ譌･譛ｬ縺ｮ莨第律繧定｡ｨ遉ｺ縺励◆縺�→諤昴▲縺溘�
`Thunderbird縺ｮweb繧ｵ繧､繝� <https://www.thunderbird.net/ja/calendar/holidays>`__
縺ｫ縺ｯ蜷�嵜縺ｮ莨第律縺ｮ諠��ｱ縺景Calender繝輔ぃ繧､繝ｫ(.ics)縺ｮ蠖｢蠑上〒蜿弱ａ繧峨ｌ縺ｦ縺�ｋ縲�
縺励°縺励∵律譛ｬ縺ｮ諠��ｱ縺ｯ2007蟷ｴ莉･髯肴峩譁ｰ縺輔ｌ縺ｦ縺�↑縺�′縲�2020-2021縺ｯ譚ｱ莠ｬ繧ｪ繝ｪ繝ｳ繝斐ャ繧ｯ縺ｮ蠖ｱ髻ｿ縺ｧ縲�
莨第律縺瑚�譎ゅ↓螟画峩縺輔ｌ縺ｦ縺�ｋ縲�(縺昴�莉悶�莨第律縺ｫ繧�2007莉･髯阪�螟画峩縺後≠繧九ゑｼ�
譌･譛ｬ縺ｮ莨第律縺ｫ縺､縺�※縺ｯ縲∝�髢｣蠎懊′縺昴�\ `繝帙�繝�繝壹�繧ｸ <https://www8.cao.go.jp/chosei/shukujitsu/gaiyou.html>`__
縺ｧ蜈ｬ蠑上↑繧｢繝翫え繝ｳ繧ｹ繧貞�縺励※縺�ｋ縲ら音縺ｫ縲≫懈亊蜥�30蟷ｴ��1955蟷ｴ�峨°繧我ｻ､蜥�4蟷ｴ��2022蟷ｴ�牙嵜豌代�逾晄律窶昴ｒ\ `csv蠖｢蠑上�繝輔ぃ繧､繝ｫ <https://www8.cao.go.jp/chosei/shukujitsu/syukujitsu.csv>`__
縺ｨ縺励※蜈ｬ髢九＠縺ｦ縺�ｋ縲�
縺薙�繝励Ο繧ｰ繝ｩ繝�縺ｮ逶ｮ逧��縺薙�csv蠖｢蠑上�繝輔ぃ繧､繝ｫ縺九ｉThunderbird縺ｪ縺ｩ縺ｮCalendar繝励Ο繧ｰ繝ｩ繝�縺ｧ蛻ｩ逕ｨ蜿ｯ閭ｽ縺ｪiCal蠖｢蠑上�繝輔ぃ繧､繝ｫ(.ics)繧堤函謌舌☆繧九％縺ｨ縺ｧ縺吶�
蛻ｩ逕ｨ縺吶ｋ繝｢繧ｸ繝･繝ｼ繝ｫ
------------------
縺薙�繝励Ο繧ｰ繝ｩ繝�縺ｧ縺ｯ莉･荳九�繝｢繧ｸ繝･繝ｼ繝ｫ繧剃ｽｿ縺�∪縺吶�\ ``import``\ 縺ｫ螟ｱ謨励☆繧九ｈ縺�〒縺励◆繧峨― ``pip``\ 縺ｪ縺ｩ縺ｮ繝��繝ｫ繧剃ｽｿ縺｣縺ｦ貅門ｙ縺励∪縺励ｇ縺��
urllib:
讓呎ｺ悶�web繧｢繧ｯ繧ｻ繧ｹ縺ｮ縺溘ａ縺ｮ繝｢繧ｸ繝･繝ｼ繝ｫ縲Ｄsv繝輔ぃ繧､繝ｫ繧偵ム繧ｦ繝ｳ繝ｭ繝ｼ繝峨☆繧九◆繧√↓菴ｿ逕ｨ縲�
io:
繝��繧ｿ繧偵≠縺溘°繧�File(stream)縺ｮ繧医≧縺ｫ蜿悶ｊ謇ｱ縺医ｋ繧医≧縺ｫ縺吶ｋ繝｢繧ｸ繝･繝ｼ繝ｫ縲ゅム繧ｦ繝ｳ繝ｭ繝ｼ繝峨＠縺溘ョ繝ｼ繧ｿ繧偵∽ｸｭ髢薙ヵ繧｡繧､繝ｫ縺ｫ菫晏ｭ倥＠縺ｪ縺�〒縲√Γ繝｢繝ｪ荳翫↓鄂ｮ縺�◆縺ｾ縺ｾ蛻ｩ逕ｨ縺吶ｋ縺溘ａ縲�
pandas: 繝��繧ｿ隗｣譫舌�縺溘ａ縺ｮ繝｢繧ｸ繝･繝ｼ繝ｫ縲ゅ％縺ｮ縺ｪ縺九�DataFrame繧貞茜逕ｨ縺吶ｋ縲�
csv繝輔ぃ繧､繝ｫ縺ｮ譌･莉倥ョ繝ｼ繧ｿ螟画鋤縺ｪ縺ｩ繧貞柑邇�ｈ縺�(遏ｭ縺��繝ｭ繧ｰ繝ｩ繝�縺ｧ�牙ｮ溽樟縺吶ｋ縺溘ａ縺ｫ蛻ｩ逕ｨ縲�
sqlite: 繝輔ぃ繧､繝ｫ繝吶�繧ｹ縺ｮRDBMS
sqlite繧剃ｽｿ縺�◆繧√�繝｢繧ｸ繝･繝ｼ繝ｫ縲ゅョ繝ｼ繧ｿ縺ｮ讀懃ｴ｢縺ｪ縺ｩ繧堤ｰ｡蜊倥↓陦後≧縺溘ａ縺ｫ蛻ｩ逕ｨ縺ｧ縺阪ｋ縲よ悽菴薙�繝励Ο繧ｰ繝ｩ繝�縺ｧ縺ｯ譛ｪ蛻ｩ逕ｨ縺ｪ縺ｮ縺ｧ縲√↑縺上※繧り憶縺��
icalendar: iCal繝��繧ｿ蜿匁桶縺ｮ縺溘ａ縺ｮ繝｢繧ｸ繝･繝ｼ繝ｫ縲Ｊcs繝輔ぃ繧､繝ｫ菴懈�縺ｫ菴ｿ逕ｨ縺吶ｋ縲�
.. code:: ipython3
#!/usr/bin/env python
# coding: utf-8
"""
This program generates ics file for the Japanese Holidays
based on the information from Japanese goverment web page.
"""
import urllib.request
from urllib.request import urlopen
# macos縺ｧ縺ｯSSL險ｼ譏取嶌繧呈ｭ｣縺励￥縺､縺九∴繧九ｈ縺�↓莉･荳九�譁�′蠢�ｦ�
import os, certifi
os.environ["SSL_CERT_FILE"]=certifi.where()
import io
from io import StringIO, BytesIO
import pandas
import sqlite3
import icalendar, pytz, datetime, uuid
from icalendar import vBoolean, vCalAddress, vDate, vDatetime,vDuration,vFloat, vFrequency, vInt, vPeriod, vText, vTime, vUri, vUTCOffset, vWeekday
JST = pytz.timezone("Asia/Tokyo")
# note: this csv uses shift-jis encoding.
JHuri="https://www8.cao.go.jp/chosei/shukujitsu/syukujitsu.csv"
# a list of codecs supported by python can be found in https://docs.python.org/ja/3/library/codecs.html
繝��繧ｿ縺ｮ繝繧ｦ繝ｳ繝ｭ繝ｼ繝�
--------------------
繝��繧ｿ繧蜘eb繧｢繝峨Ξ繧ｹ(``cvsuri``)縺九ｉ繝繧ｦ繝ｳ繝ｭ繝ｼ繝峨＠縺ｦ縲�
1. 謇句�縺ｮ繝輔ぃ繧､繝ｫ縺ｨ縺励※菫晏ｭ倥＠縺溘ｊ(``load_and_save_cvs``)縲√
2. pands
DataFrame縺ｫ螟画鋤縺励※(``load_as_dataframe``)蛻･縺ｮ繝励Ο繧ｰ繝ｩ繝�縺ｧ蛻ｩ逕ｨ縺励◆繧翫�
3. sqlite3縺ｮon memory 繝��繧ｿ繝吶せ縺ｫ螟画鋤(``load_as db``)縺吶ｋ
髢｢謨ｰ遲峨ｒ縺薙％縺ｧ螳夂ｾｩ縺励※縺�∪縺吶�
.. code:: ipython3
def load_and_save_cvs(cvsuri):
fn=cvsuri.split("/")[-1]
with urlopen(cvsuri) as inf , open(fn,"wb") as outf:
print ("downloading :", fn)
data=inf.read()
outf.write(data)
def load_as_dataframe(cvsuri):
fn=cvsuri.split("/")[-1]
with urlopen(cvsuri) as inf:
print ("downloading :", fn)
data=inf.read().decode("shift_jis") #file encoding in this csv file is shift JIS.
sio=io.StringIO(data) # store data in to StringIO object.
# interprete string in '蝗ｽ豌代�逾晄律繝ｻ莨第律譛域律'(the first) column as datetime.
df=pandas.read_csv(sio, # use StringIO object as if it is a open file object.
parse_dates=['蝗ｽ豌代�逾晄律繝ｻ莨第律譛域律'], # column 0 shoud be read as date
infer_datetime_format=True
)
# df=pandas.read_csv(sio, parse_dates=[0], infer_datetime_format=True)
print(df.info())
return df
def load_as_db(cvsuri):
"""
download csv file then convert to sqlite3 database on memory.
"""
df=load_as_dataframe(cvsuri) # create dataframe
db=sqlite3.connect(":memory:") # create sqlite3 database on memory.
df.to_sql('holidays', db) # write all data to database.
return db
Calendar 繧ｪ繝悶ず繧ｧ繧ｯ繝�
---------------------
iCal縺ｮ繝輔ぃ繧､繝ｫ繧剃ｽ懈�縺吶ｋ貅門ｙ縺ｨ縺励※縲（calender.Calendar繧ｯ繝ｩ繧ｹ繧堤ｶ呎価縺励◆Calendar
Class繧貞ｮ夂ｾｩ縺励∪縺吶ゅ％縺ｮ繧ｯ繝ｩ繧ｹ縺ｫ縺ｯ莨第律(譌･莉倥→莨第律蜷搾ｼ峨ｒ逋ｻ骭ｲ縺吶ｋ縺溘ａ縺ｮ
``add_holiday``
繝｡繧ｽ繝�ラ繧定ｿｽ蜉�縺励※縺翫″縺ｾ縺吶ゅCalendear繝輔ぃ繧､繝ｫ縺ｯicanldear.Calendar繧ｯ繝ｩ繧ｹ縺梧戟縺､縲― ``to_ical``\ 繧剃ｽｿ縺｣縺ｦ譖ｸ縺榊�縺励∪縺吶�
.. code:: ipython3
class Calendar(icalendar.Calendar):
"""
"""
# notify tis event 15 min before event
alarm_setting=icalendar.Alarm().from_ical(
"BEGIN:VALARM\n"
"ACTION:DISPLAY\n"
"TRIGGER;VALUE=DURATION:-PT15M\n"
"DESCRIPTION:Default Mozilla Description\n"
"END:VALARM"
)
def __init__(self):
"""
"""
super(icalendar.Calendar,self).__init__()
self.add(u"prodid","-//Japanese Holidays/based on Python.iCalendar//")
self.add(u"Version",2.0)
self.add(u"Category","Japanese Public Holidays")
self.add(u"Summary","Official Japanese Public Holidays ")
self.add_component(self.alarm_setting)
self.add_component(icalendar.Timezone.from_ical(
"BEGIN:VTIMEZONE\n"
"TZID:/mozilla.org/20070129_1/Asia/Tokyo\n"
"X-LIC-LOCATION:Asia/Tokyo\n"
"BEGIN:STANDARD\n"
"TZOFFSETFROM:+0900\n"
"TZOFFSETTO:+0900\n"
"TZNAME:JST\n"
"DTSTART:19700101T000000\n"
"END:STANDARD\n"
"END:VTIMEZONE\n")
)
def add_holiday(self, date, name):
ev=icalendar.Event()
ev['uid']=uuid.uuid4()
ev["categories"]=vText("Japanese Public Holidays")
ev.add(
'dtstart',
vDate(
datetime.datetime.fromtimestamp(
date.timestamp(),
tz=JST)
),
encode=False
)
ev.add(
'dtend',
vDate(
datetime.datetime.fromtimestamp(
(date + datetime.timedelta(days=1)).timestamp(),
tz=JST)
),
encode=False
)
ev.add(
'summary',
name
)
ev.add(
'description',
vText(name, 'utf-8')
)
self.add_component(ev)
繝励Ο繧ｰ繝ｩ繝�縺ｮ譛ｬ菴�
----------------
荳翫〒逕ｨ諢上＠縺滄未謨ｰ繧�け繝ｩ繧ｹ繧剃ｽｿ縺｣縺ｦweb縺九ｉ蜿悶ｊ霎ｼ繧薙□繝��繧ｿ繧剃ｽｿ縺｣縺ｦ縲（cs繝輔ぃ繧､繝ｫ繧剃ｽ懈�縺励∪縺吶�
.. code:: ipython3
def main():
# web荳翫�繝��繧ｿ縺九ｉDataFrame繧剃ｽ懈�縲�
df=load_as_dataframe(JHuri)
cal=Calendar() # Calendar 繧ｪ繝悶ず繧ｧ繧ｯ繝医ｒ菴懈�縺励．ataFrame縺ｮ莨第律繝��繧ｿ繧堤匳骭ｲ
for id, date, name in df.itertuples():
cal.add_holiday(date, name)
#.ics繝輔ぃ繧､繝ｫ繧剃ｽ懈�縺励√ョ繝ｼ繧ｿ繧段Calendar蠖｢蠑上〒譖ｸ縺榊�縺励∪縺吶�
with open(
"JapaneseHolidays.ics",
mode="w",
encoding="utf-8" # for py2app. you need explicitly specify encoding.
) as f:
s=cal.to_ical() # icalendar 蠖｢蠑上↓螟画鋤縲�
s=s.decode("utf-8", "replace") # unicode縺ｫ螟画鋤
f.write(s) #繝輔ぃ繧､繝ｫ縺ｫ譖ｸ縺榊�縺吶�
繝励Ο繧ｰ繝ｩ繝�縺ｮ螳溯｡�
----------------
螳梧�縺励◆繝励Ο繧ｰ繝ｩ繝�繧貞腰迢ｬ縺ｧ蛻ｩ逕ｨ縺吶ｋ縺薙→繧定�∴縺ｦ縲√＞縺､繧ゅ�縺翫∪縺倥↑縺�ｒ縺�ｌ縺ｦ縺翫″縺ｾ縺吶�
.. code:: ipython3
if __name__ == "__main__":
main()
print("Done!")
.. parsed-literal::
downloading : syukujitsu.csv
<class 'pandas.core.frame.DataFrame'>
RangeIndex: 975 entries, 0 to 974
Data columns (total 2 columns):
# Column Non-Null Count Dtype
--- ------ -------------- -----
0 蝗ｽ豌代�逾晄律繝ｻ莨第律譛域律 975 non-null datetime64[ns]
1 蝗ｽ豌代�逾晄律繝ｻ莨第律蜷咲ｧｰ 975 non-null object
dtypes: datetime64[ns](1), object(1)
memory usage: 15.4+ KB
None
Done!