現在位置首頁 > 博碩士論文 > 詳目
論文中文名稱:Open Data結合資料倉儲之設計與應用-以食品藥物為例 [以論文名稱查詢館藏系統]
論文英文名稱:Open Data Combined Design and Application of Data Warehouse - Food and Drug Cases [以論文名稱查詢館藏系統]
院校名稱:臺北科技大學
學院名稱:管理學院
系所名稱:資訊與財金管理系碩士班
畢業學年度:104
畢業學期:第二學期
出版年度:105
中文姓名:張家維
英文姓名:CHIA WEI CHANG
研究生學號:103AB8011
學位類別:碩士
語文別:中文
口試日期:2016/06/08
指導教授中文名:陳育威
指導教授英文名:Yu Wei Chen
口試委員中文名:吳建文;陳世賢
口試委員英文名:Yu Wei Chen;Yu Wei Chen
中文關鍵詞:開放資料資料倉儲
英文關鍵詞:Open DataData WarehouseETL
論文中文摘要:近年來食安風暴接連爆發,導致民眾對於食品藥物的產地來源、組成、是否違規等等,皆受到重視,因而食品藥物開放資料(Open Data)的重要性孕育而生。其中目前食品藥物開放資料大部分都是單一資料集,鮮少將資料整合在一起,並且缺乏一個可以整合食品藥物開放資料的查詢平台。因此本研究著重於將食品藥物開放資料整合到資料倉儲(Data Warehouse,DW)裡,以解決只能查看單一資料集問題,使得民眾可以全覽整個食品藥物資料集,清楚了解目前的食品藥物狀況,避免買到有問題的產品,提升食安品質。
本研究透過萃取(Extract)、轉換(Transform)、載入(Load) (ETL)技術,將政府食品藥物開放資料(Open Data),整合到資料倉儲(DW)裡,並建置IIS (Internet Information Service)伺服器,並且結合統計報表應用,設計一個基於食品藥物之資料倉儲系統。
本系統可以讓使用者透過本系統得知目前食品藥物開放資料的資訊,除了基本的資訊查詢外,也可對食品藥物進行混搭、多維度角度查詢。此外,使用者可將查詢結果輸出至Excel,提供民眾、企業做使用。
論文英文摘要:After having serial food safety problems in recent years, people focus more on the resources, combination, and possible violation of food safety regulations, which, furthermore, leads to a rising need for an Open Date of food and drugs. Most of the current open data for certain food and drug exist in separated and single files, and seldom are they integrated together. That means there is no integrated platform for searching these open data for food and drugs effectively. Therefore, this research aims to integrate all the open data of food and drugs into a Data Warehouse (DW), for solving the problem that people can only get information from separated files. People will be able to access the entire database and to have a more clear idea of the current condition of food and drugs. By doing so, problematic products can be prevented from being bought and the quality of food and drug will be raised.
With the techniques of extraction, transform, and loading ETL, this research has designed a data warehouse system for food and drug after integrating the Open Data of food and drugs belonging to government into the DW (data warehouse), built an Internet Information Service(IIS) , and combined the application of statistics report.
This system allows users to get all the information of food and drugs that open to the public. Besides basic searching functions, the system at the same time provides mixing and multi-dimensional searching functions. The searching results are also available to be exported into Excel spreadsheets for further usages for more people and business groups.
論文目次:摘 要 i
目 錄 ii
表目錄 iii
圖目錄 iv
第一章 緒論 1
1.1 研究背景與動機 1
1.2 研究目的 2
1.3 研究架構 3
第二章 文獻探討 4
2.1 資料倉儲 Data Warehouse 4
2.2 ETL 8
2.3 開放資料 Open Data 9
2.3.1 政府開放資料 10
2.3.2 食品藥物開放資料 13
第三章 食品藥物資料倉儲系統 14
3.1 系統架構 14
3.2 ETL設計與說明 16
3.3 實體資料模型定義 17
3.4 系統功能設計 21
第四章 實驗與結果 23
4.1 系統建置步驟 23
4.1.1 食品藥物資料庫建置 23
4.1.2 食品藥物資料倉儲建置 26
4.2 系統功能開發實作 28
4.2.1 食品查詢模組功能 28
4.2.2 藥物查詢模組功能 30
4.2.3 進階分析查詢模組功能 31
4.3 實驗結果 33
4.3.1食品查詢模組使用說明 33
4.3.2違規藥物查詢模組說明 34
第五章 結論 38
參考文獻 39
論文參考文獻:[1] 國家發展委員會, “政府開放資料平臺”,2016。
http://data.gov.tw/about
[2] 臺北市政府, “臺北市政府資料開放平台”,2015。
http://data.taiepi.gov.tw
[3] Inmon, W. H. (2005). Building the data warehouse. John wiley & sons.
[4] 黃熙勛, “資料倉儲建構訂單分配決策支援系統之研究-以人造皮革產業為例”, 碩士論文,2013。
[5] Kimball R. (1996). The Data Warehouse Toolkit, John Wiley & Sons.
[6] 黃三益,資料庫的核心理論與實務,前程文化,2009。
[7] Nithin Vijayendra. Meiliu Lu, “A Web-based ETL Tool for Data Integration Process,” HSI, 6-8 June. 2013
[8] Moss, L. T., & Atre, S. (2003). Business intelligence roadmap: the complete project lifecycle for decision-support applications. Addison-Wesley Professional.。
[9] Olson, J. E. (2003). Data quality: the accuracy dimension. Morgan Kaufmann.
[10] Kimball R, & Ross, M. (2002). The data warehouse toolkit: the
complete guide to dimensional modeling, Second Edition, John Wiley & Sons.
[11] Kimball R, & Caserta, J. (2004). The data warehouse ETL toolkit:
practical techniques for extracting, cleaning, conforming, and
delivering data", Wiley & Sons.
[12] Kimball R, & Ross, M. (2010). The Kimball group reader: relentlessly practical tools for data warehousing and business intelligence, John Wiley & Sons.
[13] Dupor, S., & Jovanovic, V. (2014, May). An approach to conceptual modelling of ETL processes. In Information and Communication Technology, Electronics and Microelectronics (MIPRO), 2014 37th International Convention on (pp. 1485-1490). IEEE.
[14] P. Vassiliadis, A. Simitsis and S. Skiadopoulos. (2002), "Modeling ETL activities as graphs," Proc. Fourth 1ntl Workshop Design and
Management of Data Warehouses, vol. 58, pp. 52-61.

[15] Simitsis, A., Vassiliadis, P., Terrovitis, M., & Skiadopoulos, S. (2005). Graph-based modeling of ETL activities with multi-level transformations and updates. In Data Warehousing and Knowledge Discovery (pp. 43-52). Springer Berlin Heidelberg.
[16] R.Agrawal, R.Srikant. (1994), Fast Algorithms for Mining Association Rules, Proceedings of the20th International Conference on Very Large Databases(VLDB’94) , pp.487-499.
[17] Utley, Craig, Business Intelligence With Microsoft Office Performancepoint Server 2007, McGraw-Hill Osborne Media, 2005.
[18] R.Agrawal, T.Imielinski and A. Swami, Mining association rules between sets of items in large databases, Proceedings of the ACM SIGMOD Conference on Management of data, 1993, 207-216.
[19] Yousfi, S., & Chiadmi, D. (2014, November). Graph file format for ETL. InComplex Systems (WCCS), 2014 Second World Conference on (pp. 189-195). IEEE.
[20] Wang, Q., Liu, N., & Yu, C. (2011, December). Research of ETL on university data exchange platform. In IT in Medicine and Education (ITME), 2011 International Symposium on (Vol. 1, pp. 285-288). IEEE.
[21] 維基百科, "開放資料",2016。
https://zh.wikipedia.org/wiki/開放資料
[22] Open Knowledge Foundation. 2012。
[23] 5stardata , http://5stardata.info/en/。
論文全文使用權限:不同意授權