1 Hadoop

2 Tip & Tech

3 참고자료

• Hive
  
• HDFS
  
• Pig
  
• Sqoop
  
• Kafka
  
  

• Installing Apache Hive 3.1.2 on Windows 10(https://towardsdatascience.com/installing-apache-hive-3-1-2-on-windows-10-70669ce79c79)
  
• WebHDFS
  
• VirtualBox에서 Hortonworks Sandbox 시작하기
  
• Installing Hadoop 3.2.1 Single node cluster on Windows 10(https://towardsdatascience.com/installing-hadoop-3-2-1-single-node-cluster-on-windows-10-ac258dd48aef)
  
• How to install a Hadoop single node cluster on Windows 10(https://www.joe0.com/2017/02/02/how-to-install-a-hadoop-single-node-cluster-on-windows-10/)
  
• Hadoop Install
  
• Hadoop 동작방식(애니메이션)
  
• Hadoop에 관한 10가지 미신 깨기
  
• 실용주의_하둡_red.docx 출처(http://socurites.com/m/post/view/id/247)
  
• Hadoop-Sizing-v01.xlsx 원본(https://0x0fff.com/wp-content/uploads/2015/08/Hadoop-Sizing-v01.xlsx)
  
• Hadoop Cluster Sizing(https://www.packtpub.com/books/content/sizing-and-configuring-your-hadoop-cluster)
  
• How to Calculate Hadoop Cluster Size(https://www.linkedin.com/pulse/how-calculate-hadoop-cluster-size-saket-jain)
  

• https://www.mapr.com/services/mapr-academy/big-data-hadoop-online-training --> 맵알 온라인 무료교육
  
• 최악의 빅데이터 프랙티스 10가지(http://www.ciokorea.com/news/21716)
  
• 빅 데이터, 10가지 흔한 오해와 착각(http://www.ciokorea.com/news/19749)
  
• http://prestodb.io/
  
• A single node Hadoop + Cassandra + Pig setup(http://frommyworkshop.blogspot.kr/2012/07/single-node-hadoop-cassandra-pig-setup.html)
  
• Hadoop Map reduce with Cassandra Cql through Pig(http://frommyworkshop.blogspot.kr/2013/07/hadoop-map-reduce-with-cassandra.html)
  
• 카산드라 우분투에 설치하기
  
• Cassandra Storage Handler(https://issues.apache.org/jira/browse/HIVE-1434)
  
  • https://github.com/riptano/hive_old cassandra-handler.zip
    
  • http://mvn.riptano.com/content/repositories/snapshots/org/apache/hive/hive-cassandra-handler/0.8.1-SNAPSHOT/
    
• 카산드라 Hadoop Support(http://wiki.apache.org/cassandra/HadoopSupport)
  
• 카산드라 Hive-QL(http://docs.wso2.org/wiki/display/BAM220/Hive+Query+Language)
  
• 카산드라 설치 및 실행(http://jidasung.blogspot.kr/2012/08/hbase-cassandra.html)
  
  • 카산드라 stop: pkill -f 'java.*cassandra'
    
  • conf/cassandra.yaml파일의 rpc_address, listen_address 를 0.0.0.0으로 세팅
    
• Flamingo Hadoop Manager(http://sourceforge.net/projects/hadoop-manager/) 사용자 및 개발자 가이드(http://confluence.openflamingo.org/pages/viewpage.action?pageId=5537913&focusedCommentId=6356996#comment-6356996)
  
• CDH4 install
  
  • http://sodamix.tistory.com/22
    
  • http://entireboy.egloos.com/4760515
    
• Oozie Install
  
  • http://apollo89.com/wordpress/?p=1649
    
  • http://blog.geekple.com/2013/02/15/oozie-install/
    
• http://bigdatablog.co.uk/install-sqoop
  
• 빅 데이터의 경제 살리기 시나리오(http://www.bikorea.net/news/articleView.html?idxno=7533)
  
• Hadoop에서의 실시간 SQL 질의: Impala(http://helloworld.naver.com/246342)
  
• phphiveadmin(http://sourceforge.net/projects/phphiveadmin/?source=directory)
  
• hadoop4win(http://sourceforge.net/projects/hadoop4win/files/latest/download?source=directory)
  
• How To Connect Excel to Hadoop on Azure via HiveODBC (en-US)(http://social.technet.microsoft.com/wiki/contents/articles/6226.how-to-connect-excel-to-hadoop-on-azure-via-hiveodbc-en-us.aspx)
  
• Microsoft BigData(http://www.microsoft.com/sqlserver/en/us/solutions-technologies/business-intelligence/big-data.aspx)
  
• Drive Smarter Decisions with Microsoft Big Data(http://strataconf.com/stratany2012/public/schedule/detail/26926)
  
• 2012 빅데이터 전문가로 가는 길 - 세미나 동영상(http://cyber.dbguide.net/user/apply/Apply.jsp)
  
• 어떤 사례를 보니.. 2.4GHz 4Core, 32GB RAM, 50대의 장비로 기존의 꺼를 10시간에서 3시간으로 단축시켰다고 나오더라.. 이정도 장비면 굳이 하둡이 아니더라도.. 쩝..
  
• Hadoop cygwin에 설치
  
  • http://simsiss1.tistory.com/archive/20110211
    
  • http://knight76.tistory.com/1396
    
• Hadoop and SQL Server Connector(동영상)(http://www.youtube.com/watch?v=WijhB6uRdcA&feature=related)
  
• Sqoop 개발자 가이드(http://mczo.blogspot.com/2012/03/sqoop.html) Sqoop_Dev_Guide.docx
  
• Sqoop 사용자 가이드(http://mczo.blogspot.com/2012/04/sqoop.html) Sqoop_User_Guide.docx
  
• Accessing HDFS over FTP(http://nubetech.co/accessing-hdfs-over-ftp)
  
• Hadoop: CHD installation on CentOS (multi nodes)(http://hyper-choi.blogspot.com/2011/12/hadoop-chd-installation-on-centos-multi.html)
  
• Installing Hadoop 0.21.0 on Windows – Installing Hadoop Map\Reduce(http://blog.benhall.me.uk/2011/01/installing-hadoop-0210-on-windows_18.html)
  
• 27 December, 2011: release 1.0.0 available
  
• http://www.hadoop.or.kr/
  
• pig install(http://mimul.com/pebble/default/)
  
• Cloudera Hadoop
  
• Hadoop on Windows with Eclipse(http://v-lad.org/Tutorials/Hadoop/00%20-%20Intro.html)
  
• Windows7을 기반으로 Cygwin을 사용하여 설치(http://cardia.tistory.com/search/hadoop)
  
• Upload new Attachment "Third_Nature_open_source_DW_Feb_2008.pdf"
  
• 하둡설치 문서(http://blog.daum.net/maxmin93/13380892)
  
• HADOOP configure 정리(http://airguy76.blog.me/150087361763)
  
• hadoop의 secondary namenode는 백업용이 아닙니다
  
• 2대 이상의 장비로 구축하는 Hadoop, HBase 분산 처리 시스템(http://blog.naver.com/PostView.nhn?blogId=kh_24&logNo=30085252376&categoryNo=29&parentCategoryNo=0&viewDate=¤tPage=1&postListTopCurrentPage=1&isAfterWrite=true&userTopListOpen=true&userTopListCount=5&userTopListManageOpen=false&userTopListCurrentPage=1)
  
• Apache Hive client(http://nuget.org/packages/Hive.Sharp.Lib)
  
• https://bitbucket.org/vadim/hive-sharp/downloads/hive-sharp-lib.dll
  
• Hadoop Basics for SQL Server DBAs(http://www.brentozar.com/archive/2011/11/hadoop-basics-for-sql-server-dbas/)
  
• Microsoft SQL Server Connector for Apache Hadoop(http://www.microsoft.com/download/en/details.aspx?id=27584)
  
• Hadoop과 오픈소스 소프트웨어를 이용한 비지니스 인텔리전스 플랫폼 구축
  
• Writing An Hadoop MapReduce Program In Python(http://www.michael-noll.com/tutorials/writing-an-hadoop-mapreduce-program-in-python/)
  
• Hadoop
  
  • 싱글노드클러스터 하둡설치 및 워드 카운팅 방법(http://dbckdgns0515.tistory.com/entry/%EB%B2%88%EC%97%AD-%EC%8B%B1%EA%B8%80%EB%85%B8%EB%93%9C%ED%81%B4%EB%9F%AC%EC%8A%A4%ED%84%B0-%ED%95%98%EB%91%A1%EC%84%A4%EC%B9%98-%EB%B0%8F-%EC%9B%8C%EB%93%9C-%EC%B9%B4%EC%9A%B4%ED%8C%85-%EB%B0%A9%EB%B2%95)
    
  • 아파치 하둡 맵리듀스 기반 애플리케이션 구현하기 Part 1(https://www.ibm.com/developerworks/mydeveloperworks/blogs/9e635b49-09e9-4c23-8999-a4d461aeace2/entry/274?lang=ko)
    
  • 클라우드에서 MapReduce 및 로드 밸런싱 사용하기(http://www.ibm.com/developerworks/kr/cloud/library/cl-mapreduce/index.html?ca=drs-)
    
  • Hadoop 설치하기
    
  • Hadoop을 이용한 분산 데이터 처리, Part 1: 시작(http://www.ibm.com/developerworks/kr/library/l-hadoop-1/index.html?ca=drs-)
    
  • Hadoop을 이용한 분산 데이터 처리, Part 2: 추가 주제(http://www.ibm.com/developerworks/kr/library/l-hadoop-2/index.html?ca=drs-)
    
  • Hadoop을 이용한 분산 데이터 처리, Part 3: 애플리케이션 개발(http://www.ibm.com/developerworks/kr/library/l-hadoop-3/index.html?ca=drs-)
    
  • Ubuntu Linux에서 Hadoop을 구성하기 위한 문서
    
    • Running Hadoop On Ubuntu Linux (Single-Node Cluster)(http://www.michael-noll.com/wiki/Running_Hadoop_On_Ubuntu_Linux_(Single-Node_Cluster))
      
    • Running Hadoop On Ubuntu Linux (Multi-Node Cluster)(http://www.michael-noll.com/wiki/Running_Hadoop_On_Ubuntu_Linux_(Multi-Node_Cluster))
      
• HBase, Hive, CloudBase(http://iam312.pe.kr/280)
  
• Yahoo Hadoop Tutorial(http://developer.yahoo.com/hadoop/tutorial/index.html)
  
• HadoopDB
  
  • HadoopDB Quick Start Guide(http://hadoopdb.sourceforge.net/guide/)
    
  • Up and Running with HadoopDB
    
  • http://hadoopdb.sourceforge.net
    
  • http://hadoopdb.sourceforge.net/doc/
    
  • http://changyy.pixnet.net/blog/post/25623671
    
• Hive
  
  • Hive : Installation and Configuration(http://sehwa4444.egloos.com/3228886)
    
  • https://cwiki.apache.org/Hive/
    
  • Hive : DDL, DML, SQL Operations(http://julingks.tistory.com/137)
    
  • Data Warehousing & Analytics on Hadoop(http://www.slideshare.net/zshao/hive-data-warehousing-analytics-on-hadoop-presentation)
    
  • Hive 서버와 Hive Python 클라이언트 사용하기
    
  • Hive 시작하기 (PostgreSQL을 로컬 메타스토어 RDBMS로 사용)(http://mixellaneous.tistory.com/807)
    
• RHIPE: An Interface Between Hadoop and R for Large and Complex Data Analysis(http://www.lecturemaker.com/2011/02/rhipe/)
  
• KLDP Apache Hadoop MapReduce(http://wiki.kldp.org/wiki.php/Apache%20Hadoop%20MapReduce)
  
• HBase, Hive, CloudBase(http://iam312.pe.kr/280)
  
• cloud base 설치 및 환경 설정(http://www.hadoop.or.kr/?document_srl=2229)
  
• Column-oriented DBMS(http://en.wikipedia.org/wiki/Column-oriented_DBMS)
  
• VirtualBox에 설치된 os와 pc 통신하기(http://phoenix208.blog.me/40145404229)
  
• HyperTable(http://hypertable.org/index.html)
  
• 클라우드 컴퓨팅 아키텍처, 어떻게 발전해갈 것인가?(http://www.ciobiz.co.kr/news/articleView.html?idxno=2926)
  
• Hadoop Korean User Group(http://www.hadoop.co.kr/)
  
• 하둡의 퍼포먼스 (삽질기)(http://deisys.tistory.com/108)
  
• CouchDB와 그루비의 RESTClient를 이용한 REST(http://www.ibm.com/developerworks/kr/library/j-javadev2-5/index.html)
  
• HyperSQL Database Engine(http://sourceforge.net/projects/hsqldb/)
  

좋은 자료 공유 감사합니다. -- 규호 2014-04-05 22:00:01