Skip to content
This repository has been archived by the owner on Jan 20, 2022. It is now read-only.

Releases: twitter/summingbird

Performance Bug Fix, Memory Platform duplicate execution fix

23 Jun 21:16
Compare
Choose a tag to compare

Performance fix for when number of outstanding futures is high #663
Memory Platform duplicate execution fix #667

Performance bug fix

16 Nov 17:22
Compare
Choose a tag to compare
  • Fixes a bug in the LTuple2 class. Add a test for it: #632

Scalding alignment improvements

22 Oct 20:28
Compare
Choose a tag to compare

Bring in some of the Config changes from scalding into Summingbird, as a result killing off most of its own configuration code around hadoop properties.

  • Removing internal config setup from scalding platform: #629
  • Remove store that no one seems to use and has no tests: #630
  • Ianoc/optimization changes: #628
  • Fixes tests: #626
  • resilient to all stores being complete: #627
  • Resilient to a store being ahead: #625
  • move to scala test: #621
  • Killing off Summingbird Java: #624
  • Kill summingbird spark: #622
  • Bumping sbt versions: #623
  • Fixed erroneous comment in ClientStore's merge description: #620

New versions of Algebird and Scalding

29 May 02:09
Compare
Choose a tag to compare
  • bumping Scalding to 0.15.0, algebird to 0.10.2

Summingbird 0.7.0 Released!

18 May 21:09
Compare
Choose a tag to compare
  • Registering summingbird counters with tormenta spouts #553
  • Add counters to default summers #571
  • Fixes the types off the summingbird java storm api #601
  • Adding explicit hadoop deps; dfs-datastores to 1.3.6 #592
  • Replace deprecated ClassManifest and erasure #608
  • Spark monad #607
  • replace deprecated erasure by runtimeClass #609
  • Revert "Remove StripNameNodes" #610
  • refactored core-tests into separate sub-project #593
  • Fix checking delta batch in readDeltaTimestamps in batched store when merging #612
  • ensure at least one batch before merging #613
  • MergeableStoreFactory extends java.io.Serializable #616
  • Spout storm metrics foreach #617
  • upgrade scalacheck #615
  • Use latest bijection, algebird, scalding, storehaus, chill, and tormenta

Counters, self leftJoins, latest libraries, and more!

11 Feb 23:02
Compare
Choose a tag to compare
  • Use latest bijection, algebird, scalding, storehaus, chill, and tormenta #565
  • Remove scala 2.9 support #565
  • Add counters to default summers #571
  • Registering summingbird counters with tormenta spouts #553
  • Remove StripNameNodes: #587
  • Revert unneeded wrapper in DagOptimizer: #584
  • Make some classes public so we can make custom platforms: #564
  • IdentityKeyedProducer in ValueFlatMapToFlatMap Dag Optimizer rule: #580
  • Lazy store init for CombinedServiceStoreFactory: #582
  • Pass the reducers option down to leftJoin: #578
  • Rename readBatched to readAfterLastBatch: #577
  • Fixes BatchedStore interval calculation: #573
  • Support for creating a store-service for Storm platform: #563
  • Support leftJoin against a store in offline platform: #557
  • Counters for ConcurrentMemory platform: #550
  • Summingbird Storm/Online refactor: #544
  • Memory platform counters: #548
  • Example of using DagOptimizer: #538

Cross platform statistics, and java support

14 Jul 05:33
Compare
Choose a tag to compare

Rolls 0.5.0 and 0.5.1 since 0.5.0 never made it to maven central due to javadoc issues in java packages.

  • Change the javac options for doc generation in java to be successful. (Blocks maven publishing)

    0.5.0

  • Bumps version of other projects. Changes to compile with latest scalding...: #533
  • Safely checking for the internal storm Implementation detail: #528
  • add implicit Successible and Predecessible for Timestamp: #530
  • Removes redundant Future.unit call: #526
  • Optimize CalendarBatcher a bit: #527
  • Fixes java publishing to not error in the doc generation/publishing -- i...: #519
  • Fix online plan bug with multiple serial summers and certain no-ops: #524
  • Fixing tormentaSpout.registerMetric call in scheduleSpout: #521
  • Use scalariform: #520
  • Adds a test for a bug if a flatMap immediately before a leftJoin produce...: #518
  • Fixed Storm stats bug with Promise: #514
  • Platform-independent stats storm scalding: #503
  • Experimental Java API and example: #499
  • First pass at a spark platform for summingbird: #502
  • Add summingbird logo: #504
  • expose flow object to mutate function: #501
  • Support java6 with our one java file: #498
  • New async summers from algebird: #497
  • Feature/stat store: #495
  • Add some option documentation: #491
  • Yet another cache: #470
  • Monoid to semigroup: #487

Minor pt release, few fixes

25 Apr 22:03
Compare
Choose a tag to compare
  • Use scalding version 0.9.0rc17 which has some bug fixes
  • Add fully satisfiable flag to UniqueKeyedService: #489
  • Mark the scalding platform as serializable, but also don't grab the platform in the scalding env: #485
  • smoketest displaying error running example: #483

Chunky bits again

20 Mar 18:56
Compare
Choose a tag to compare
  • Add/use the multiplier option: #481
  • add variations on pipeFactory to allow a map function before time extrac...: #482
  • Make HDFSState public: #478
  • Feature/ianoc frozen keys: #477
  • Piping prune function through the VersionedStore factory method: #476
  • Remove deprecation indirections: #472
  • fix unidoc target: #469
  • Add hadoop2 compression options: #466
  • Few more profiler noticed changes, mostly Future.collect indexedSeq's. O...: #465
  • Add deprecation: #463
  • Vagrant folder added to .gitignore: #464
  • Manually block up sections of output from caches into lists to avoid flo...: #453
  • Fixes bug that meant storm tests weren't running: #460
  • Factor batch from online: #455
  • This moves from using the completeTopology approach to running it normal...: #458
  • Code is called heavily, and in tests where we do it 100's of times it wa...: #457
  • Clean up a little bit of this code. Uses seq/traversable once in some ap...: #456
  • This refactors time out of several places inside the online code. Allows...: #454
  • Move the hadoop defaults into scalding platform: #452
  • Feature/add option to tune output sizes online: #451
  • Move to using Mergable from storehaus instead of mergable store.: #450
  • Feature/state deprecated ptrs: #449
  • Adds BatchID interval to TS interval: #443
  • Adds a scalding-test project: #447
  • Make Commutativity settings a case object: #448
  • Splits the storm test code out into its own package to help end users be...: #442
  • Add toString to InitialBatchedStore: #444
  • Feature/long to timestamp offline: #439
  • Feature/add pruning support: #435
  • Split the scalding platform out into packages: #434
  • Add mima command support: #427
  • Add PipeFactoryOps, with mapElements, flatMapElements and mapPipe: #432
  • Feature/move code from scalding: #424

Chunky bits

20 Mar 04:34
Compare
Choose a tag to compare

Release tooling seems to have broken down. This release should not be used. Its 0.3.3 with just updated version numbers. 0.4.1 will be released shortly as a fixed version.