Open Source Python Distributed Computing Software

Ganglia is a scalable distributed monitoring system for high-performance computing systems such as clusters and Grids. It is based on a hierarchical design targeted at federations of clusters. Supports clusters up to 2000 nodes in size.

CGRU is an open source CG tools pack, includes Afanasy render farm manager and RULES project tracker.

<<Hack|Track GNU/Linux is an open source operating system developed by the HTGL Project from Indonesia which provides penetration testing.

dispy is a generic and comprehensive, yet easy to use framework for creating and using compute clusters to execute computations in parallel across multiple processors in a single machine (SMP), among many machines in a cluster, grid or cloud. dispy is well suited for data parallel (SIMD) paradigm where a computation (Python function or standalone program) is evaluated with different (large) datasets independently. dispy supports public / private / hybrid cloud computing, fog / edge computing.

Released August 22, 2013 Lubuntu Blends: Biochemistry 13.04 (Raring) v5.44 Linux Kernel Image 3.8.0-29 Lubuntu Blends are pre-installed Wubi disk image remixes of Ubuntu and Debian Science meta packages, A custom boot loader allows installations to be copied and automatically booted from most external or USB flash drives. Once up and running, use earlier Lubuntu Remix README instructions here until documentation is updated. https://sourceforge.net/projects/portable-linux/files/ Installation 1. Download the Wubi installer http://releases.ubuntu.com/saucy/wubi.exe 2. Install any flavor of Ubuntu. 3. Swap out the root.disk with the ones provided here. Overview LAMP stack running on localhost (127.0.0.1). Scientific, productivity & media packages include R (Rattle Data Miner), GridEngine, Condor, cooperative computing tools, WINE, LibreOffice, Evolution, Clinica, Neuro Debian Desktop, PsycoPy, OpenVibe, 3DSlicer, Paraview, Openshot. Cheers, Gregory Remington

Slurm is a replacement for other resource management software and schedulers like gridengine or torque. The slurm roll integrates very well into a rocks clusters installation. In the folder addons, there are a lot of useful rolls for rocks clusters 6.1 and 6.2. These rolls do not depend on slurm. Please see Discussion for further information and support

The purpose of the project is to develop a portable programming framework that facilitates distributed and multi-threaded programming for C++, Java, and Python. MADARA was originally developed as an agent-based middleware specifically for real-time, distributed artificial intelligence, but is now more general purpose for distributed timing, control, knowledge and reasoning, and quality-of-service. MADARA is composed of several tools and middleware, and the main entry point into the system is the Knowledge and Reasoning Language (KaRL) Engine, which provides a real-time scripting language for nanosecond execution times hooked into a flexible transport layer for distributed reasoning. The KaRL engine also supports object-oriented C++, Java, and Python programming through Containers, classes that provide abstractions and references for variable location within the KaRL Knowledge Base. This project is currently in process of being ported from http://madara.googlecode.com.

The Systems Biology Workbench(SBW) is a framework for application intercommunications. It uses a broker-based, distributed, message-passing architecture, supports many languages including Java, C++, Perl & Python, and runs under Linux,OSX & Win32. It comes with a large number of modules, encompassing the whole modeling cycle: creating computational models, simulating and analyzing them, visualizing the information, in order to improve the models. All using community standards, such as SED-ML, SBML and MIRIAM.

FLoM is a free open source distributed lock manager that can be used to synchronize shell commands, scripts and custom developed software. When used in a shell environment, FLoM manages process synchronization in the same way that "nice" manages process prioritization. Shell commands, scripts and custom programs can be synchronized inside a single system or in a network of IP connected systems. FLoM supports different types of abstract resources: simple, numeric, set, hierarchical and transactional sequence. libflom, the library shipped with FLoM, allows you to develop your own application using a simple C, C++, Java, Perl, PHP or Python client API. SSL/TLS security for network communication, X.509 certificates for peer to peer mutual authentication.

CloudI is an open-source private cloud computing framework for efficient, secure, and internal data processing. CloudI provides scaling for previously unscalable source code with efficient fault-tolerant execution of ATS, C/C++, Erlang/Elixir, Go, Haskell, Java, JavaScript/node.js, OCaml, Perl, PHP, Python, Ruby, or Rust services. The bare essentials for efficient fault-tolerant processing on a cloud!

Dowser is a research tool for the web. It clusters results from search engines, associates words that appear in previous searches, and keeps a local cache of all the results you click on in a searchable database. It helps you keep track of what you find.

PyMW is a Python module for parallel master-worker computing in a variety of environments. With the PyMW module, users can write a single program that scales from multicore machines to global computing platforms.

RPyC, or Remote Python Call, is a transparent and symmetrical python library for remote procedure calls, clustering and distributed-computing.

asyncoro is a Python framework for developing concurrent, distributed, network programs with asynchronous completions and coroutines. Asynchronous completions implemented in asyncoro are sockets (non-blocking sockets), database cursors, sleep timers and locking primitives. Programs developed with asyncoro have same logic and structure as Python programs with threads, except for a few syntactic changes. asyncoro supports socket I/O notification mechanisms epoll, kqueue, /dev/poll (and poll and select, where necessary), and Windows I/O Completion Ports (IOCP) for high performance and scalability, and SSL for security

SF2 is a generic framework for constructing cloud computing platform. The framework provides snapshot-based replication, virtual machine placement on multiple sites, and gossip-based physical machine discovery.

The MUSCLE system is a fast, portable, flexible client-server system for distributed applications. Clients send BMessage-like PortableMessages to each other either directly or via a centralized server (with built-in database and 'live query' support).

PuSSH is Pythonic, Ubiquitous SSH, a Python wrapper/script that runs commands in parallel on clusters/ranges of linux/unix machines via SSH, ideally where SSH is configured to use Kerberos, RSA/DSA keys, or ssh-agent as to avoid password authentication.

Spyse is a software framework for building multi-agent systems. It allows Python developers to build distributed intelligent systems of multiple cooperative agents based on FIPA, OWL, SOA and many others. Spyse is designed for ease-of-use and fun.

UNICORE is a software suite for building federated systems, providing secure and seamless access to heterogeneous resource such as compute clusters and file systems. UNICORE deals with authentication, user mapping and authorization, and provides a comprehensive set of RESTful APIs for HPC access and workflows. Contributors: visit https://github.com/UNICORE-EU

LIXA (LIbre XA) is an open source and free Transaction Manager implementing the distributed transaction processing "XA specification" and "TX (transaction demarcation) specification" according to the X/Open CAE Specification. LIXA implements even XTA: XA Transaction API, an innovative API that implements XA transactional context passing among different applications. LIXA is a Transaction Manager but it's not a Transaction Monitor: this is the distinguishing feature of the project. LIXA technology enables every application container, like a web server or a shell, to become a two phase commit application server. The client/server architecture of LIXA allows many application containers to share a single LIXA (state) server: this is ideal when horizontal scalability is a must and many identical application containers must refer to a single transactional environment. LIXA can be used with the C, C++, Java, Python and COBOL programming languages.

Publish and subscribe messaging for the Web, and related tools. Our license is BSD.

A very lightweight Python program that executes commands on multiple Linux hosts in a user-designated number of threads via SSH. Intended for management for a large number of Linux/Unix nodes

AKIRA aims to create a C++ development framework to build cognitive architectures and complex artificial intelligent agents.Features:KQML,Fuzzy Logic,Neural Net,Fuzzy Cognitive Maps and DIPRA (a distributed BDI - Belief Desire Intention goals model)

ActiveGrid is an Enterprise Web 2.0 solution that allows the composition of code-free applications that comply with corporate IT standards. Technologies include Python, Java, XForm, Xpath, WSDL, CSS, XML Schema (XSD), XACML, and BPEL.