[SOLVED] Java MapReduce

https://raw.githubusercontent.com/sidooms/MovieTweetings/master/latest/ratings.dat (https://raw.githubusercontent.com/sidooms/MovieTweetings/master/latest/ratings.dat)
user1 Titanic10. user_id::movie_id::rating::timestamp idid
ABABUM
U1::M1::2::11111111
U2::M2::3::11111111
U2::M3::1::11111111
U3::M1::4::11111111
U4::M2::5::11111111
U5::M2::3::11111111
U5::M1::1::11111111
U5::M3::3::11111111
stringmappertimestamp

(M1,M2) [(U5,1,3)]
(M2,M3) [(U5,3,3),(U2,3,1)]
(M1,M3) [(U5,1,3)]
MM[ ]listU513 U5M1M213.

Mapper/ReducerMapReducehttps://stackoverflow.com/questions/38111700/chaining-of-mapreduce- jobs#answer-38113499 (https://stackoverflow.com/questions/38111700/chaining-of-mapreduce- jobs#answer-38113499)
self-joinreduce-side join patternhttps://www.edureka.co/blog/mapreduce-example-reduce-side-join/ (https://www.edureka.co/blog/mapreduce-example-reduce-side-join/)
MapperkeyvalueReducekeyvaluejob.setMapOutputKeyClass(), job.setOutputKeyClass(), job.setMapOutputValueClass(), job.setapOutputValueClass()
Combinerjob.setCombiner()
Mapper/ReducervalueobjectWriterable Interface class
Mapper/ReducerkeyobjectWritableComparable Interface
ArrayWritableArray valuestoStringobject
reducerIterable valuesvalue listobject instancereducerlist

2019/10/25 23:59

project
hadoop dependencyproject
eclipseJava project
2.dependency https://github.com/mysilver/COMP9313/raw/master/Hadoop- Core.jar (https://github.com/mysilver/COMP9313/raw/master/Hadoop-Core.jar)
3.Hadoop-Core.jar:Build-Path -> add External Archives

()AssigOne{zid}.java5
CSE/:
$ javac -cp .:Hadoop-Core.jar AssigOne{zid}.java
$ java -cp .:Hadoop-Core.jar AssigOne{zid}INPUT_PATH OUTPUT_PATH
CSE(:williamswagner)give:
$ give cs9313 assig1 AssigOne{zid}.java
zid{zid}
WebCMSGive: https://cgi.cse.unsw.edu.au/~ Give /Student/give.php (https://cgi.cse.unsw.edu.au/~ Give /Student/give.php)
,(Maisie Badami, [email protected] (mailto:[email protected]))

:
Hadoop MapReduce(7)
2. (2)
(M2,M3) [(U5,3,3)(U2,3,1)]:(M2,M3) [ ]
3.()
(4)
4. CSE(2)
5. MapperReducer2(22)(2)
6. (300)(3)