319 Event Data Collection

SIMON P目的

SIMON P基於文化 (歷史) 與情報考量，大量收集事件相關資料。

有隱私問題的資料要處理或略過。

SIMON P範圍 (暫定)

• SIMON PPTT post

Simon Pai用 tkirby 的工具可砍

• Facebook post
• news report
• blog article
• video stream record

Simon PaiUStream recorded video 有 timestamp

• video transcripts
• misc video clips
• 立委質詢影片
• https://hackpad.com/323-vA3xcpQnSCB
• https://www.youtube.com/user/marktwaingroup

Simon Paiyoutube 還沒找到 timestamp orz

• g0v IRC
• CAASI Hpadnews parse hackpad 文字直播的結果：

caasi Huang十分陽春，若有更好的處理方式，歡迎 patch 或告知。
venevcassi ++ 非常好閱讀的介面
• http://padnews.linode.caasigd.org/
• API
• latest: http://padnews.linode.caasigd.org/json/
• all: http://padnews.linode.caasigd.org/json/all/
• single entry: http://padnews.linode.caasigd.org/json/0/
• repos
• parser: https://github.com/g0v/padnews
• cli: https://github.com/g0v/padnews-cli
• web: https://github.com/g0v/padnews-web

• SIMON P實體報紙
• photo albums?
• 小道消息?

SIMON P格式需求

• SIMON P內容
• 來源
• timestamp 或 time range

Video: tag/comment by timestamp?

SIMON PTools

• SIMON Phttps://github.com/zbryikt/ptt-crawler
• https://www.npmjs.org/package/streamy-data
• https://github.com/g0v/padnews

SIMON PKnown Source Sites

• SIMON Phttp://taiwan0314.s3-website-ap-northeast-1.amazonaws.com/
• http://www.appledaily.com.tw/realtimenews/article/new/20140329/369121/
• http://time-fumao.rhcloud.com/index.html

SIMON PApplication

• SIMON Pl km thiann tioh in gin

Simon Paiuse file hash to identify duplicated resource?
Simon Painews archiving