Remote Hadoop Configuration
I'm developing a Webapp (that includes Spring-data-hadoop) on a windows Box. I installed Hadoop on a remote Ubuntu instance (in Amazon Ec2 cloud). How Can I set the connection to Hadoop from my local...
View ArticleUsing Hadoop Cluster Remotely
Hi The background thread is here: http://stackoverflow.com/questions/13682647/using-hadoop-cluster-remotely I have a web application and no of remote clusters which can be anywhere so can my web...
View ArticleHow to set number of reduce tasks in my Job with a Partitioner
Hi!, I'm new in this forum and I'm starting with spring-hadoop. I have some problems that I would like if someone could help me. I'm trying to test the Partitioner and I don't get to set up the reduce...
View ArticleLimit on MAP_INPUT_BYTES when using CascadingTasklet
Hi, I am currently working on a Spring Batch job that runs a Cascading job as one of the steps. In order to run the Cascading job I have made use of the CascadingTasklet class. The problem I am facing...
View ArticleAvro job
Hi all, I am trying to setup a job taking avro files as input and producing an avro file. I managed to read avro records in my Mapper (extending org.apache.hadoop.mapreduce.Mapper, so new API). My...
View ArticleRepository class for multi column table in HBase
Hi, I am planning to use Spring data for connecting to HBase. How to model repository class / DAO class for HBase table with multiple column family. Should it be treated as single repository or...
View ArticleDeveloping Solutions Using Apache Hadoop
Course Description: This training course is designed for developers who want to better understand how to create Apache Hadoop solutions. This 35 Hours provides Java programmers the necessary training...
View ArticleJaime Webcam - adult chat friend
Free Live Nude Webcam Chat - qpix webcam Free Sex Teen Chat Rooms. Gay Man Chat Webcams Cam free adult picture chat; FREE PORN VIDEOCHAT! Naked Indian Girl Webcam Video webcam girls forum!!! Lesbians...
View ArticleJob-runner able to submit jobs without app jar?
Hi, Haven't tried SDFH, but looking at docs, I can see that the way to submit job is via following XML snipet: Code: <hdp:job-runner id="myjob-runner" pre-action="cleanup-script"...
View ArticleSHDP future
I have opened ticket related to hadoop-2.x with how to fix instructions inside: https://jira.springsource.org/browse/SHDP-130 it got no activity, also there is very little activity on development...
View ArticleSpring Batch with HiveTasklet giving error
I am trying to execute the apachelog hive example with hiveTasklet. The hiveTasklet is launched but it throws error : 16:44:49.246 [pool-2-thread-1] INFO org.apache.hadoop.hive.ql.exec.Task - set...
View ArticleWrong XSD on springframework.org for GA
both xsds: http://www.springframework.org/schem...hadoop-1.0.xsd http://www.springframework.org/schem...ing-hadoop.xsd have: version="1.0.0.M1" and are out of sync with:...
View ArticleSpring Data Hadoop Build Errors
I was trying to compile the source and the build seems to be failing for default hadoop 1.0.4 as well as 2.0.3 1.0.4 $./gradlew .... Could not resolve all dependencies for configuration ':optional'....
View ArticleIs it possible to configure MiniDFSCluster as hadoopConfiguration
Hi, Is it possible to configure MiniDFSCluster as hadoopConfiguration for running unit tests? Thanks Srinivas
View ArticleSSH Tunnel to AWS EMR (Amazon Web Services, Elastic Map Reduce)
Hi, I try to follow http://static.springsource.org/sprin...mazon-emr.html from a windows PC but run into a few troubles. What does exactly "you must add your external source IP for TCP Port 22 to the...
View ArticleHadoop Distcp issue when copying a file with spaces in the name
Hi, I am currently running into an issues when calling the spring hadoop distcp passing in a file with spaces in the name. I was wondering if there is a way around this. Thanks, Kevin
View ArticleHow to use the Scan object with HbaseTemplate
Hi, I have posted this same question at stackoverflow also, but still did not get a reply for that. Can someone please give me an idea of this? I have plugged in Spring for Hadoop and it works well....
View ArticleTransitional support for HBase
Hi, Does SHDP, provides transitional support for HBase and if yes how to achieve it. Is it possible to integrate any of other transaction support frameworks / libs (for example : Omid) along with SHDP....
View ArticleHadoop tool-tasklet fails with space in jar path on Windows
I am wondering if someone knows a workaround for this issue I've been encountering... I am setting up a Spring Batch workflow, using "hdp:tool-tasklet" with my hadoop job jar file. When the workflow...
View Article