#title Hadoop & Apache [[TableOfContents]] https://sourceforge.net/projects/getprathamos/files/CDH_6.3.2_CentOS7.7z.001/download * [클라우데라 배포판 설치 후기] ==== Hadoop ==== * [Hive] * [HDFS] * [Pig] * [Sqoop] * [Kafka] ==== Tip & Tech ==== * [https://towardsdatascience.com/installing-apache-hive-3-1-2-on-windows-10-70669ce79c79 Installing Apache Hive 3.1.2 on Windows 10] * [WebHDFS] * [VirtualBox에서 Hortonworks Sandbox 시작하기] * [https://towardsdatascience.com/installing-hadoop-3-2-1-single-node-cluster-on-windows-10-ac258dd48aef Installing Hadoop 3.2.1 Single node cluster on Windows 10] * [https://www.joe0.com/2017/02/02/how-to-install-a-hadoop-single-node-cluster-on-windows-10/ How to install a Hadoop single node cluster on Windows 10] * [Hadoop Install] * [attachment:OpenSource/hadoop_action.pptx Hadoop 동작방식(애니메이션)] * [Hadoop에 관한 10가지 미신 깨기] * attachment:Hadoop/실용주의_하둡_red.docx [http://socurites.com/m/post/view/id/247 출처] * attachment:Hadoop/Hadoop-Sizing-v01.xlsx [https://0x0fff.com/wp-content/uploads/2015/08/Hadoop-Sizing-v01.xlsx 원본] * [https://www.packtpub.com/books/content/sizing-and-configuring-your-hadoop-cluster Hadoop Cluster Sizing] * [https://www.linkedin.com/pulse/how-calculate-hadoop-cluster-size-saket-jain How to Calculate Hadoop Cluster Size] ==== 참고자료 ==== * https://www.mapr.com/services/mapr-academy/big-data-hadoop-online-training --> 맵알 온라인 무료교육 * [http://www.ciokorea.com/news/21716 최악의 빅데이터 프랙티스 10가지] * [http://www.ciokorea.com/news/19749 빅 데이터, 10가지 흔한 오해와 착각] * http://prestodb.io/ * [http://frommyworkshop.blogspot.kr/2012/07/single-node-hadoop-cassandra-pig-setup.html A single node Hadoop + Cassandra + Pig setup] * [http://frommyworkshop.blogspot.kr/2013/07/hadoop-map-reduce-with-cassandra.html Hadoop Map reduce with Cassandra Cql through Pig] * [카산드라 우분투에 설치하기] * [https://issues.apache.org/jira/browse/HIVE-1434 Cassandra Storage Handler] * https://github.com/riptano/hive_old attachment:Hadoop/cassandra-handler.zip * http://mvn.riptano.com/content/repositories/snapshots/org/apache/hive/hive-cassandra-handler/0.8.1-SNAPSHOT/ * [http://wiki.apache.org/cassandra/HadoopSupport 카산드라 Hadoop Support] * [http://docs.wso2.org/wiki/display/BAM220/Hive+Query+Language 카산드라 Hive-QL] * [http://jidasung.blogspot.kr/2012/08/hbase-cassandra.html 카산드라 설치 및 실행] * {{{카산드라 stop: pkill -f 'java.*cassandra'}}} * {{{conf/cassandra.yaml파일의 rpc_address, listen_address 를 0.0.0.0으로 세팅}}} * [http://sourceforge.net/projects/hadoop-manager/ Flamingo Hadoop Manager] [http://confluence.openflamingo.org/pages/viewpage.action?pageId=5537913&focusedCommentId=6356996#comment-6356996 사용자 및 개발자 가이드] * CDH4 install * http://sodamix.tistory.com/22 * http://entireboy.egloos.com/4760515 * Oozie Install * http://apollo89.com/wordpress/?p=1649 * http://blog.geekple.com/2013/02/15/oozie-install/ * http://bigdatablog.co.uk/install-sqoop * [http://www.bikorea.net/news/articleView.html?idxno=7533 빅 데이터의 경제 살리기 시나리오] * [http://helloworld.naver.com/246342 Hadoop에서의 실시간 SQL 질의: Impala] * [http://sourceforge.net/projects/phphiveadmin/?source=directory phphiveadmin] * [http://sourceforge.net/projects/hadoop4win/files/latest/download?source=directory hadoop4win] * [http://social.technet.microsoft.com/wiki/contents/articles/6226.how-to-connect-excel-to-hadoop-on-azure-via-hiveodbc-en-us.aspx How To Connect Excel to Hadoop on Azure via HiveODBC (en-US)] * [http://www.microsoft.com/sqlserver/en/us/solutions-technologies/business-intelligence/big-data.aspx Microsoft BigData] * [http://strataconf.com/stratany2012/public/schedule/detail/26926 Drive Smarter Decisions with Microsoft Big Data] * [http://cyber.dbguide.net/user/apply/Apply.jsp 2012 빅데이터 전문가로 가는 길 - 세미나 동영상] * 어떤 사례를 보니.. 2.4GHz 4Core, 32GB RAM, 50대의 장비로 기존의 꺼를 10시간에서 3시간으로 단축시켰다고 나오더라.. 이정도 장비면 굳이 하둡이 아니더라도.. 쩝.. * Hadoop cygwin에 설치 * http://simsiss1.tistory.com/archive/20110211 * http://knight76.tistory.com/1396 * [http://www.youtube.com/watch?v=WijhB6uRdcA&feature=related Hadoop and SQL Server Connector(동영상)] * [http://mczo.blogspot.com/2012/03/sqoop.html Sqoop 개발자 가이드] attachment:OpenSource/Sqoop_Dev_Guide.docx * [http://mczo.blogspot.com/2012/04/sqoop.html Sqoop 사용자 가이드] attachment:OpenSource/Sqoop_User_Guide.docx * [http://nubetech.co/accessing-hdfs-over-ftp Accessing HDFS over FTP] * [http://hyper-choi.blogspot.com/2011/12/hadoop-chd-installation-on-centos-multi.html Hadoop: CHD installation on CentOS (multi nodes)] * [http://blog.benhall.me.uk/2011/01/installing-hadoop-0210-on-windows_18.html Installing Hadoop 0.21.0 on Windows – Installing Hadoop Map\Reduce] * 27 December, 2011: release 1.0.0 available * http://www.hadoop.or.kr/ * [http://mimul.com/pebble/default/ pig install] * [Cloudera Hadoop] * [http://v-lad.org/Tutorials/Hadoop/00%20-%20Intro.html Hadoop on Windows with Eclipse] * [http://cardia.tistory.com/search/hadoop Windows7을 기반으로 Cygwin을 사용하여 설치] * [attachment:Third_Nature_open_source_DW_Feb_2008.pdf Open Source Data warehousing] * [http://blog.daum.net/maxmin93/13380892 하둡설치 문서] * [http://airguy76.blog.me/150087361763 HADOOP configure 정리] * [hadoop의 secondary namenode는 백업용이 아닙니다] * [http://blog.naver.com/PostView.nhn?blogId=kh_24&logNo=30085252376&categoryNo=29&parentCategoryNo=0&viewDate=¤tPage=1&postListTopCurrentPage=1&isAfterWrite=true&userTopListOpen=true&userTopListCount=5&userTopListManageOpen=false&userTopListCurrentPage=1 2대 이상의 장비로 구축하는 Hadoop, HBase 분산 처리 시스템] * [http://nuget.org/packages/Hive.Sharp.Lib Apache Hive client] * https://bitbucket.org/vadim/hive-sharp/downloads/hive-sharp-lib.dll * [http://www.brentozar.com/archive/2011/11/hadoop-basics-for-sql-server-dbas/ Hadoop Basics for SQL Server DBAs] * [http://www.microsoft.com/download/en/details.aspx?id=27584 Microsoft SQL Server Connector for Apache Hadoop] * [attachment:OpenSource/PlatformDay2009-Hadoop_OSBI-YoungwooKim.pdf Hadoop과 오픈소스 소프트웨어를 이용한 비지니스 인텔리전스 플랫폼 구축] * [http://www.michael-noll.com/tutorials/writing-an-hadoop-mapreduce-program-in-python/ Writing An Hadoop MapReduce Program In Python] * Hadoop * [http://dbckdgns0515.tistory.com/entry/%EB%B2%88%EC%97%AD-%EC%8B%B1%EA%B8%80%EB%85%B8%EB%93%9C%ED%81%B4%EB%9F%AC%EC%8A%A4%ED%84%B0-%ED%95%98%EB%91%A1%EC%84%A4%EC%B9%98-%EB%B0%8F-%EC%9B%8C%EB%93%9C-%EC%B9%B4%EC%9A%B4%ED%8C%85-%EB%B0%A9%EB%B2%95 싱글노드클러스터 하둡설치 및 워드 카운팅 방법] * [https://www.ibm.com/developerworks/mydeveloperworks/blogs/9e635b49-09e9-4c23-8999-a4d461aeace2/entry/274?lang=ko 아파치 하둡 맵리듀스 기반 애플리케이션 구현하기 Part 1] * [http://www.ibm.com/developerworks/kr/cloud/library/cl-mapreduce/index.html?ca=drs- 클라우드에서 MapReduce 및 로드 밸런싱 사용하기] * [Hadoop 설치하기] * [http://www.ibm.com/developerworks/kr/library/l-hadoop-1/index.html?ca=drs- Hadoop을 이용한 분산 데이터 처리, Part 1: 시작] * [http://www.ibm.com/developerworks/kr/library/l-hadoop-2/index.html?ca=drs- Hadoop을 이용한 분산 데이터 처리, Part 2: 추가 주제] * [http://www.ibm.com/developerworks/kr/library/l-hadoop-3/index.html?ca=drs- Hadoop을 이용한 분산 데이터 처리, Part 3: 애플리케이션 개발] * Ubuntu Linux에서 Hadoop을 구성하기 위한 문서 * [http://www.michael-noll.com/wiki/Running_Hadoop_On_Ubuntu_Linux_(Single-Node_Cluster) Running Hadoop On Ubuntu Linux (Single-Node Cluster)] * [http://www.michael-noll.com/wiki/Running_Hadoop_On_Ubuntu_Linux_(Multi-Node_Cluster) Running Hadoop On Ubuntu Linux (Multi-Node Cluster)] * [http://iam312.pe.kr/280 HBase, Hive, CloudBase] * [http://developer.yahoo.com/hadoop/tutorial/index.html Yahoo Hadoop Tutorial] * HadoopDB * [http://hadoopdb.sourceforge.net/guide/ HadoopDB Quick Start Guide] * [Up and Running with HadoopDB] * http://hadoopdb.sourceforge.net * http://hadoopdb.sourceforge.net/doc/ * http://changyy.pixnet.net/blog/post/25623671 * Hive * [http://sehwa4444.egloos.com/3228886 Hive : Installation and Configuration] * https://cwiki.apache.org/Hive/ * [http://julingks.tistory.com/137 Hive : DDL, DML, SQL Operations] * [http://www.slideshare.net/zshao/hive-data-warehousing-analytics-on-hadoop-presentation Data Warehousing & Analytics on Hadoop] * [Hive 서버와 Hive Python 클라이언트 사용하기] * [http://mixellaneous.tistory.com/807 Hive 시작하기 (PostgreSQL을 로컬 메타스토어 RDBMS로 사용)] * [http://www.lecturemaker.com/2011/02/rhipe/ RHIPE: An Interface Between Hadoop and R for Large and Complex Data Analysis] * [http://wiki.kldp.org/wiki.php/Apache%20Hadoop%20MapReduce KLDP Apache Hadoop MapReduce] * [http://iam312.pe.kr/280 HBase, Hive, CloudBase] * [http://www.hadoop.or.kr/?document_srl=2229 cloud base 설치 및 환경 설정] * [http://en.wikipedia.org/wiki/Column-oriented_DBMS Column-oriented DBMS] * [http://phoenix208.blog.me/40145404229 VirtualBox에 설치된 os와 pc 통신하기] * [http://hypertable.org/index.html HyperTable] * [http://www.ciobiz.co.kr/news/articleView.html?idxno=2926 클라우드 컴퓨팅 아키텍처, 어떻게 발전해갈 것인가?] * [http://www.hadoop.co.kr/ Hadoop Korean User Group] * [http://deisys.tistory.com/108 하둡의 퍼포먼스 (삽질기)] * [http://www.ibm.com/developerworks/kr/library/j-javadev2-5/index.html CouchDB와 그루비의 RESTClient를 이용한 REST] * [http://sourceforge.net/projects/hsqldb/ HyperSQL Database Engine] ---- 좋은 자료 공유 감사합니다. -- 규호 2014-04-05 22:00:01