Release Notes - Mesos - Version 1.5.1 (WIP)

-------------------------------------------

* This is a bug fix release.

** Bug

* [MESOS-1720] - Slave should send exited executor message when the executor is never launched.

* [MESOS-7742] - Race conditions in IOSwitchboard: listening on unix socket and premature closing of the connection.

* [MESOS-8125] - Agent should properly handle recovering an executor when its pid is reused.

* [MESOS-8411] - Killing a queued task can lead to the command executor never terminating.

* [MESOS-8468] - `LAUNCH_GROUP` failure tears down the default executor.

* [MESOS-8510] - URI disk profile adaptor does not consider plugin type for a profile.

* [MESOS-8552] - CGROUPS_ROOT_PidNamespaceForward and CGROUPS_ROOT_PidNamespaceBackward tests fail.

* [MESOS-8565] - Persistent volumes are not visible in Mesos UI when launching a pod using default executor.

* [MESOS-8569] - Allow newline characters when decoding base64 strings in stout.

* [MESOS-8577] - Destroy nested container if `LAUNCH_NESTED_CONTAINER_SESSION` fails.

* [MESOS-8598] - Allow empty resource provider selector in `UriDiskProfileAdaptor`.

* [MESOS-8601] - Master crashes during slave reregistration after failover.

Release Notes - Mesos - Version 1.5.0

-------------------------------------------

This release contains the following new features:

* [MESOS-1739] - **Experimental** Agents now support the

`--reconfiguration_policy` flag which allows them to recover

the agent ID and running tasks after configuration changes.

See docs/agent-recovery.md for more details.

* [MESOS-4945] - **Experimental** Agents now can automatically

garbage collect unused Docker image layers used by Mesos

Containerizer.

* [MESOS-7289, MESOS-7235] - **Experimental** Support for the

Container Storage Interface (CSI) to simplify storage management

in Mesos, and allow 3rdparty vendors to plugin into Mesos very

easily.

* [MESOS-7302] - Support launching standalone containers on the

agent using MesosContainerizer without a master or framework

running.

* [MESOS-7749] - **Experimental** Support for gRPC client in Mesos.

The gRPC is bundled in Mesos and a gRPC client API is built is

built into libprocess.

* [MESOS-7973] - **Experimental** Non-leading replica is now allowed

to catch-up missing log positions in the replicated log. This opens

the door for implementing hot standby (by offloading some reading

from a leader to standbys) and fast failover time (by keeping

in-memory storage represented by the log “hot”).

* Several improvements and fixes to the enforcement of quota

guarantees have been made:

* [MESOS-4527]: Previously a role could "game" the quota system

by amassing reservations that it leaves unused. This is now

prevented by accounting for reservations when allocating

resources.

* [MESOS-7099]: Resources are now allocated in a fine-grained

manner to prevent roles from exceeding their quota.

* [MESOS-8293]: There was a bug where a role may not receive its

reservation when it does not have quota, this has been fixed.

* [MESOS-8339]: When a role has more reservations than quota,

there was a bug previously where an insufficient amount of

quota headroom was held. This has been fixed.

* [MESOS-8352]: When allocating to a role with quota, we

previously included all other resources on the agent that the

role does not have quota for. This made it possible to violate

the quota guarantees of a different role. This has been fixed

by taking into account the headroom that is needed when

allocating the resources.

Deprecations/Removals:

* [MESOS-7305] - Some nested container agent APIs `****_NESTED_CONTAINER`

are deprecated in favor of the new generally named agent APIs

`****_CONTAINER`.

* Agent flag `--executor_secret_key` has been deprecated. Operators

should use `--jwt_secret_key` instead.

Additional API Changes:

* [MESOS-6406, MESOS-7215, MESOS-8337] Now when an agent is partitioned,

the master tracks all noncompleted tasks regardless of partition-awareness

so when the agent reregisters it can recover all of them and send their

latest statuses to the scheduler. NOTE: The master now sends updates for

tasks recovered from partitioned agents upon reregistration so the scheduler

can get them before reconciliation. We also fixed the buggy semantics that

exposes terminal unacknowledged tasks when partitioned as "completed" in the

HTTP endpoints and the operator API, now they are shown as "unreachable". We

plan to further improve the API on this in MESOS-8405.

* [MESOS-7550] The fields `Resource.disk.source.path.root` and

`Resource.disk.source.mount.root` can now be set to relative paths

to an agent's work directory.

* [MESOS-7660] `Filter::refuse_seconds` is now capped to 31536000

seconds (365 days).

* [MESOS-7941] Built-in executors will now send a TASK_STARTING

status update when a task is starting.

* [MESOS-7973] A new `catchup` method has been added to the

`Log.Reader` interface (including Java binding).

* [MESOS-8040] Return nested/standalone containers in `GET_CONTAINERS`

API call.

* [MESOS-8165] Master will now send TASK_GONE status for unknown

tasks of PARTITION_AWARE frameworks belonging to registered agents

during explicit reconciliation.

Changes to Dependencies:

* Upgraded minimum required Protobuf library to version 3+.

Feature Graduations:

* [MESOS-4791] - v1 Operator API is now considered stable. The performance has

been improved so that when using protobuf it is faster than v0, and when

using JSON it is slightly slower than v0.

* [MESOS-5116] - Add support for accounting only mode in XFS isolator.

* [MESOS-5275, MESOS-7476, MESOS-7477, MESOS-7671] - Add file-based and

protobuf-based capabilities support for mesos containerizer. This

includes the support for effective and bounding capabilities.

* [MESOS-6077] - Added a default (task group) executor.

* [MESOS-6402] - rlimit support for Mesos containerizer.

* [MESOS-6460] - Container Attach/Exec.

* [MESOS-6758] - Support docker registry that requires basic auth.

* [MESOS-7088] - Support private registry credential per container.

* [MESOS-7418] - Add support for file-based secrets.

Unresolved Critical Issues:

* [MESOS-1718] - Command executor can overcommit the agent.

* [MESOS-2554] - Slave flaps when using --slave_subsystems that are not used for isolation.

* [MESOS-2774] - SIGSEGV received during process::MessageEncoder::encode().

* [MESOS-2842] - Update FrameworkInfo.principal on framework re-registration.

* [MESOS-3533] - Unable to find and run URIs files.

* [MESOS-3747] - HTTP Scheduler API no longer allows FrameworkInfo.user to be empty string.

* [MESOS-4996] - 'containerizer->update' will always fail after killing a docker container.

* [MESOS-5352] - Docker volume isolator cleanup can be blocked by first cleanup failure.

* [MESOS-5396] - After failover, master does not remove agents with same UPID.

* [MESOS-5989] - Libevent SSL Socket downgrade code accesses uninitialized memory / assumes single peek is sufficient.

* [MESOS-5995] - Protobuf JSON deserialisation does not accept numbers formated as strings.

* [MESOS-6632] - ContainerLogger might leak FD if container launch fails.

* [MESOS-6804] - Running 'tty' inside a debug container that has a tty reports "Not a tty".

* [MESOS-6986] - abort in DRFSorter::add.

* [MESOS-7386] - Executor not cleaning up existing running docker containers if external logrotate/logger processes die/killed.

* [MESOS-7566] - Master crash due to failed check in DRFSorter::remove.

* [MESOS-7622] - Agent can crash if a HTTP executor tries to retry subscription in running state.

* [MESOS-7721] - Master's agent removal rate limit also applies to agent unreachability.

* [MESOS-7748] - Slow subscribers of streaming APIs can lead to Mesos OOMing.

* [MESOS-7911] - Non-checkpointing framework's tasks should not be marked LOST when agent disconnects.

* [MESOS-7966] - check for maintenance on agent causes fatal error.

* [MESOS-7991] - fatal, check failed !framework->recovered().

* [MESOS-8038] - Launching GPU task sporadically fails.

* [MESOS-8125] - Agent should properly handle recovering an executor when its pid is reused.

* [MESOS-8137] - Mesos agent can hang during startup.

* [MESOS-8256] - Libprocess can silently deadlock due to worker thread exhaustion.

* [MESOS-8411] - Killing a queued task can lead to the command executor never terminating.

* [MESOS-8468] - `LAUNCH_GROUP` failure tears down the default executor.

All Resolved Issues:

** Bug

* [MESOS-1216] - Attributes comparator operator should allow multiple attributes of same name and type.

* [MESOS-3576] - Audit CMake linking flags.

* [MESOS-5455] - Transition away from temporary build variables.

* [MESOS-5462] - Re-organize isolator hierarchy.

* [MESOS-5656] - Incomplete modelling of 3rdparty dependencies in cmake build.

* [MESOS-5881] - Semantics of `os::symlink` differ across POSIX and Windows.

* [MESOS-5905] - Zookeeper tests do not work on CMake builds as directory structure changed.

* [MESOS-6086] - PersistentVolumeEndpointsTest.EndpointCreateThenOfferRemove is flaky.

* [MESOS-6187] - "double free or corruption" with Java 8.

* [MESOS-6345] - ExamplesTest.PersistentVolumeFramework failing due to double free corruption on Ubuntu 14.04.

* [MESOS-6406] - Send latest status for partition-aware tasks when agent reregisters.

* [MESOS-6428] - Mesos containerizer helper function signalSafeWriteStatus is not AS-Safe.

* [MESOS-6616] - Error: dereferencing type-punned pointer will break strict-aliasing rules.

* [MESOS-6671] - External 3rdparty deps are not built with the configured compiler in cmake build.

* [MESOS-6690] - Wire up resource control API to Windows Job objects API.

* [MESOS-6697] - Port `authentication_tests.cpp`.

* [MESOS-6703] - Port `credentials_tests.cpp`.

* [MESOS-6705] - Port `fetcher_tests.cpp`.

* [MESOS-6708] - Port `group_tests.cpp`.

* [MESOS-6735] - `os::realpath` semantics differ between Windows and POSIX.

* [MESOS-6784] - IOSwitchboardTest.KillSwitchboardContainerDestroyed is flaky.

* [MESOS-6790] - Wrong task started time in webui.

* [MESOS-6794] - Properly model header dependencies of cmake build components.

* [MESOS-6816] - Allows frameworks to overwrite system environment variables.

* [MESOS-6942] - CMake build with `-DENABLE_LIBEVENT=ON` requires system-installed `openssl`.

* [MESOS-6949] - SchedulerTest.MasterFailover is flaky.

* [MESOS-7007] - filesystem/shared and --default_container_info broken since 1.1.

* [MESOS-7099] - Quota can be exceeded due to coarse-grained offer technique.

* [MESOS-7130] - port_mapping isolator: executor hangs when running on EC2.

* [MESOS-7160] - Parsing of perf version segfaults.

* [MESOS-7215] - Race condition on re-registration of non-partition-aware frameworks.

* [MESOS-7223] - Linux filesystem isolator cannot mount host volume /dev/log.

* [MESOS-7296] - CMake 2.8.10 does not support TIMESTAMP.

* [MESOS-7312] - Update Resource proto for storage resource providers.

* [MESOS-7425] - ImageAlpine/ProvisionerDockerTest.ROOT_INTERNET_CURL_SimpleCommand/3 is flaky in some OS.

* [MESOS-7440] - Various DefaultExecutorCheckTest* tests flaky on ASF CI.

* [MESOS-7500] - Command checks via agent lead to flaky tests.

* [MESOS-7504] - Parent's mount namespace cannot be determined when launching a nested container.

* [MESOS-7509] - CniIsolatorPortMapperTest.ROOT_INTERNET_CURL_PortMapper fails on some Linux distros.

* [MESOS-7511] - CniIsolatorTest.ROOT_DynamicAddDelofCniConfig is flaky.

* [MESOS-7519] - OversubscriptionTest.RescindRevocableOfferWithIncreasedRevocable is flaky.

* [MESOS-7541] - Cannot compile without pre-compiled headers on Windows.

* [MESOS-7586] - Make use of cout/cerr and glog consistent.

* [MESOS-7589] - CommandExecutorCheckTest.CommandCheckDeliveredAndReconciled is flaky.

* [MESOS-7660] - HierarchicalAllocator uses the default filter instead of a very long one.

* [MESOS-7661] - Libprocess timers with long durations trigger immediately.

* [MESOS-7704] - Remove use of #pragma comment (lib, "IPHLPAPI.lib").

* [MESOS-7726] - MasterTest.IgnoreOldAgentReregistration test is flaky.

* [MESOS-7729] - ExamplesTest.DynamicReservationFramework is flaky.

* [MESOS-7741] - SlaveRecoveryTest/0.MultipleSlaves has double free corruption.

* [MESOS-7781] - Windows API GetVersionExW was declared deprecated.

* [MESOS-7784] - MasterTestPrePostReservationRefinement.CreateAndDestroyVolumesV1 is flaky.

* [MESOS-7791] - subprocess' childMain using ABORT when encountering user errors.

* [MESOS-7811] - libprocess-tests depend on gtest but it's not setup.

* [MESOS-7828] - Current approach to parse protobuf enum from JSON does not support upgrades.

* [MESOS-7835] - CMake build does not support Marathon.

* [MESOS-7851] - Master stores old resource format in the registry.

* [MESOS-7867] - Master doesn't handle scheduler driver downgrade from HTTP based to PID based.

* [MESOS-7873] - Expose `ExecutorInfo.ContainerInfo.NetworkInfo` in Mesos `state` endpoint.

* [MESOS-7877] - Audit test code for undefined behavior in accessing container elements.

* [MESOS-7917] - Docker statistics not reported on Windows.

* [MESOS-7921] - ProcessManager::resume sometimes crashes accessing EventQueue.

* [MESOS-7923] - Make args optional in mesos port mapper plugin.

* [MESOS-7927] - The composing containerizer leaks memory in some scenarios.

* [MESOS-7929] - `Metrics()` hangs on second call on Windows.

* [MESOS-7945] - MasterAPITest.EventAuthorizationFiltering is flaky.

* [MESOS-7963] - Task groups can lose the container limitation status.

* [MESOS-7964] - Heavy-duty GC makes the agent unresponsive.

* [MESOS-7968] - Handle `/proc/self/ns/pid_for_children` when parsing available namespace.

* [MESOS-7969] - Handle cgroups v2 hierarchy when parsing /proc/self/cgroups.

* [MESOS-7972] - SlaveTest.HTTPSchedulerSlaveRestart test is flaky.

* [MESOS-7975] - The command/default/docker executor can incorrectly send a TASK_FINISHED update even when the task is killed.

* [MESOS-7978] - Lint javascript files to enable linting.

* [MESOS-7980] - Stout fails to compile with libc >= 2.26.

* [MESOS-7988] - Mesos attempts to open handle for the system idle process.

* [MESOS-7993] - Fix Windows header orderings.

* [MESOS-7996] - ContentType/SchedulerTest.NoOffersWithAllRolesSuppressed is flaky.

* [MESOS-7997] - ContentType/MasterAPITest.CreateAndDestroyVolumes is flaky.

* [MESOS-7998] - PersistentVolumeEndpointsTest.UnreserveVolumeResources is flaky.

* [MESOS-8000] - DefaultExecutorCniTest.ROOT_VerifyContainerIP is flaky.

* [MESOS-8001] - PersistentVolumeEndpointsTest.NoAuthentication is flaky.

* [MESOS-8003] - PersistentVolumeEndpointsTest.SlavesEndpointFullResources is flaky.

* [MESOS-8010] - AfterTest.Loop is flaky.

* [MESOS-8027] - os::open doesn't always atomically apply O_CLOEXEC.

* [MESOS-8035] - Correct mesos-tests CMake build dependencies.

* [MESOS-8039] - A broken connection during LaunchNestedContainer call might result in the nested container not being cleaned up.

* [MESOS-8046] - MasterTestPrePostReservationRefinement.ReserveAndUnreserveResourcesV1 is flaky.

* [MESOS-8048] - ReservationEndpointsTest.GoodReserveAndUnreserveACL is flaky.

* [MESOS-8051] - Killing TASK_GROUP fail to kill some tasks.

* [MESOS-8052] - "protoc" not found when running "make -j4 check" directly in stout.

* [MESOS-8057] - Apply security patches to AngularJS and JQuery in the Mesos UI.

* [MESOS-8058] - Agent and master can race when updating agent state.

* [MESOS-8066] - Pylint report errors in apply-reviews.py on Ubuntu 14.04.

* [MESOS-8070] - Bundled GRPC build does not build on Debian 8.

* [MESOS-8076] - PersistentVolumeTest.SharedPersistentVolumeRescindOnDestroy is flaky.

* [MESOS-8080] - The default executor does not propagate missing task exit status correctly.

* [MESOS-8082] - updateAvailable races with a periodic allocation and leads to flaky tests.

* [MESOS-8084] - Double free corruption in tests due to parallel manipulation of signal and control handlers.

* [MESOS-8085] - No point in deallocate() for a framework for maintenance if it is deactivated.

* [MESOS-8090] - Mesos 1.4.0 crashes with 1.3.x agent with oversubscription.

* [MESOS-8093] - Some tests miss subscribed event because expectation is set after event fires.

* [MESOS-8095] - ResourceProviderRegistrarTest.AgentRegistrar is flaky.

* [MESOS-8116] - Fix off by-one error in Windows long path support.

* [MESOS-8119] - ROOT_DOCKER_DockerHealthyTask segfaults in debian 8.

* [MESOS-8121] - Unified Containerizer Auto backend should check xfs ftype for overlayfs backend.

* [MESOS-8123] - GPU tests are failing due to TASK_STARTING.

* [MESOS-8135] - Masters can lose track of tasks' executor IDs.

* [MESOS-8136] - Update XFS isolator tests to handle TASK_STARTING.

* [MESOS-8157] - Review #62775 broke the build.

* [MESOS-8159] - ns::clone uses an async signal unsafe stack.

* [MESOS-8165] - TASK_UNKNOWN status is ambiguous.

* [MESOS-8169] - Incorrect master validation forces executor IDs to be globally unique.

* [MESOS-8171] - Using a failoverTimeout of 0 with Mesos native scheduler client can result in infinite subscribe loop.

* [MESOS-8173] - Improve fetcher exit status message.

* [MESOS-8178] - UnreachableAgentReregisterAfterFailover is flaky.

* [MESOS-8179] - Scheduler library has incorrect assumptions about connections.

* [MESOS-8180] - Port mesos-fetcher to Windows.

* [MESOS-8200] - Suppressed roles are not honoured for v1 scheduler subscribe requests.

* [MESOS-8217] - Don't run linters on every commit.

* [MESOS-8220] - Can't build with Visual Studio 15.5.

* [MESOS-8223] - Master crashes when suppressed on subscribe is enabled.

* [MESOS-8225] - Port os::which to Windows.

* [MESOS-8237] - Strip (Offer|Resource).allocation_info for non-MULTI_ROLE schedulers.

* [MESOS-8245] - SlaveRecoveryTest/0.ReconnectExecutor is flaky.

* [MESOS-8249] - Support image prune in mesos containerizer and provisioner.

* [MESOS-8263] - ResourceProviderManagerHttpApiTest.ConvertResources is flaky.

* [MESOS-8267] - NestedMesosContainerizerTest.ROOT_CGROUPS_RecoverLauncherOrphans is flaky.

* [MESOS-8272] - Fall back to bind mounting container devices.

* [MESOS-8279] - Persistent volumes are not visible in Mesos UI using default executor on Linux.

* [MESOS-8280] - Mesos Containerizer GC should set 'layers' after checkpointing layer ids in provisioner.

* [MESOS-8282] - Take pending offer operations into account when calculating framework allocated resources.

* [MESOS-8288] - SlaveTest.IgnoreV0ExecutorIfItReregistersWithoutReconnect is flaky.

* [MESOS-8289] - ReservationTest.MasterFailover is flaky when run with `RESOURCE_PROVIDER` capability.

* [MESOS-8293] - Reservation may not be allocated when the role has no quota.

* [MESOS-8297] - Built-in driver-based executors ignore kill task if the task has not been launched.

* [MESOS-8312] - Pass resource provider information to master as part of UpdateSlaveMessage.

* [MESOS-8315] - ResourceProviderManagerHttpApiTest.ResubscribeResourceProvider is flaky.

* [MESOS-8316] - Tests that fetch docker images might be flaky due to insufficient wait timeout.

* [MESOS-8318] - OfferOperationStatusUpdateManagerTest tests fail on Windows.

* [MESOS-8320] - Expose information about local resource providers in master.

* [MESOS-8325] - Mesos containerizer does not properly handle old running containers.

* [MESOS-8337] - Invalid state transition attempted when agent is lost.

* [MESOS-8339] - Quota headroom may be insufficiently held when role has more reservation than quota.

* [MESOS-8341] - Agent can become stuck in (re-)registering state during upgrades.

* [MESOS-8344] - Improve JSON v1 operator API performance.

* [MESOS-8346] - Resubscription of a resource provider will crash the agent if its HTTP connection isn't closed.

* [MESOS-8349] - When a resource provider driver is disconnected, it fails to reconnect.

* [MESOS-8350] - Resource provider-capable agents not correctly synchronizing checkpointed agent resources on reregistration.

* [MESOS-8352] - Resources may get over allocated to some roles while fail to meet the quota of other roles.

* [MESOS-8356] - Persistent volume ownership is set to root despite of sandbox owner (frameworkInfo.user) when docker executor is used.

* [MESOS-8369] - CI build failure compiling volume_profile.proto.

* [MESOS-8376] - Bundled GRPC does not build on Debian 9.

* [MESOS-8377] - RecoverTest.CatchupTruncated is flaky.

* [MESOS-8391] - Mesos agent doesn't notice that a pod task exits or crashes after the agent restart.

* [MESOS-8393] - SLRP NewVolumeRecovery and LaunchTaskRecovery tests CHECK failures.

* [MESOS-8410] - Reconfiguration policy fails to handle mount disk resources.

* [MESOS-8417] - Mesos can get "stuck" when a Process throws an exception.

* [MESOS-8419] - RP manager incorrectly setting framework ID leads to CHECK failure.

* [MESOS-8422] - Master's UpdateSlave handler not correctly updating terminated operations.

* [MESOS-8443] - Fix Docker Containerizer PATH on Windows so Docker is usable.

* [MESOS-8444] - GC failure causes agent miss to detach virtual paths for the executor's sandbox.

* [MESOS-8446] - Agent miss to detach `virtualLatestPath` for the executor's sandbox during recovery.

* [MESOS-8460] - `Slave::detachFile` can segfault because it could use invalid Framework*.

* [MESOS-8461] - SLRP should no assume a CSI plugin always has GetNodeID implemented.

* [MESOS-8469] - Mesos master might drop some events in the operator API stream.

* [MESOS-8480] - Mesos returns high resource usage when killing a Docker task.

* [MESOS-8481] - Agent reboot during checkpointing may result in empty checkpoints.

* [MESOS-8514] - SLRP failed to connect to CSI endpoint.

** Documentation

* [MESOS-5078] - Document TaskStatus reasons.

* [MESOS-7663] - Update the documentation to reflect the addition of reservation refinement.

* [MESOS-8007] - Add documentation for MARK_AGENT_GONE call.

* [MESOS-8303] - Add user doc for agent reconfiguration.

* [MESOS-8304] - Update CHANGELOG to call out agent reconfiguration feature.

* [MESOS-8310] - Document container image garbage collection.

** Epic

* [MESOS-1739] - Allow slave reconfiguration on restart.

* [MESOS-4945] - Garbage collect unused docker layers in the store.

* [MESOS-7235] - Improve Storage Support using Resource Provider and CSI.

* [MESOS-7289] - Support Container Storage Interface (CSI).

* [MESOS-7302] - Support launching standalone containers.

* [MESOS-7749] - Support gRPC client.

** Improvement

* [MESOS-564] - Update Contribution Documentation.

* [MESOS-5675] - Add support for master capabilities.

* [MESOS-5771] - Add benchmark test for shared resources.

* [MESOS-5902] - CMake should generate protobuf definitions for Java.

* [MESOS-6350] - Raise minimum required cmake version.

* [MESOS-6390] - Ensure Python support scripts are linted.

* [MESOS-6971] - Use arena allocation to improve protobuf message passing performance.

* [MESOS-7306] - Support mount propagation for host volumes.

* [MESOS-7330] - Add resource provider to offer.

* [MESOS-7361] - Command checks via agent pollute agent logs.

* [MESOS-7370] - Fix create symlink code to use flag which enables non-admins to make symlinks.

* [MESOS-7497] - Remove CMake anti-pattern of `set(x "${x} ..")`.

* [MESOS-7616] - Consider supporting changes to agent's domain without full drain.

* [MESOS-7675] - Isolate network ports.

* [MESOS-7695] - Add heartbeats to master stream API.

* [MESOS-7737] - Harden Mesos when building with cmake.

* [MESOS-7785] - Pass Operator API subscription events through authorizer.

* [MESOS-7795] - Remove "latest" symlink after agent reboot.

* [MESOS-7798] - Improve libprocess message passing performance.

* [MESOS-7837] - Propagate resource updates from local resource providers to master.

* [MESOS-7840] - Add Mesos CLI command to list active tasks.

* [MESOS-7842] - Basic sandbox GC metrics.

* [MESOS-7861] - Include check output in the DefaultExecutor log.

* [MESOS-7880] - Add an option to skip the Mesos style check when applying a review chain.

* [MESOS-7889] - Avoid Multiple PROTOC invocations when generating Protobuf & GRPC code in libprocess.

* [MESOS-7895] - ZK session timeout is unconfigurable in agent and scheduler drivers.

* [MESOS-7916] - Improve the test coverage of the DefaultExecutor.

* [MESOS-7924] - Add a javascript linter to the webui.

* [MESOS-7941] - Send TASK_STARTING status from built-in executors.

* [MESOS-7951] - Design Doc for Extended KillPolicy.

* [MESOS-7961] - Display task health in the webui.

* [MESOS-7962] - Display task state counters in the framework page of the webui.

* [MESOS-7973] - Non-leading VOTING replica catch-up.

* [MESOS-7987] - Initialize Google Mock rather than Google Test.

* [MESOS-8012] - Support Znode paths for masters in the new CLI.

* [MESOS-8015] - Design a scheduler (V1) HTTP API authenticatee mechanism.

* [MESOS-8016] - Introduce modularized HTTP authenticatee.

* [MESOS-8017] - Introduce a basic HTTP authenticatee.

* [MESOS-8021] - Update HTTP scheduler library to allow for modularized authenticatee.

* [MESOS-8034] - Remove LIBNAME_VERSION from EXTERNAL.

* [MESOS-8040] - Return nested/standalone containers in `GET_CONTAINERS` API call.

* [MESOS-8072] - Change Mesos common events verbose logs to use VLOG(2) instead of 1.

* [MESOS-8074] - Change Libprocess actor state transitions verbose logs to use VLOG(3) instead of 2.

* [MESOS-8078] - Some fields went missing with no replacement in api/v1.

* [MESOS-8115] - Add a master flag to disallow agents that are not configured with fault domain.

* [MESOS-8117] - Update Getting Started documentation.

* [MESOS-8221] - Use protobuf reflection to simplify downgrading of resources.

* [MESOS-8286] - Making bind mounts readonly fails with user namespaces.

* [MESOS-8294] - Support container image basic auto gc.

* [MESOS-8295] - Add excluded image parameter to containerizer::pruneImages() interface.

* [MESOS-8301] - Support moving into defer/dispatch/install handlers.

* [MESOS-8302] - Improve master failover performance.

* [MESOS-8328] - Improve logs displayed after a slave failed recovery.

* [MESOS-8358] - Create agent endpoints for pruning images.

* [MESOS-8365] - Create AuthN support for prune images API.

* [MESOS-8421] - Duration operators drop precision, even when used with integers.

* [MESOS-8455] - Avoid unnecessary copying of protobuf in the v1 API.

** Task

* [MESOS-3107] - Define CMake style guide.

* [MESOS-3110] - Harden the CMake system-dependency-locating routines.

* [MESOS-3384] - Include libsasl in Windows CMake build.

* [MESOS-3437] - Port flags_tests.

* [MESOS-4527] - Roles can exceed limit allocation via reservations.

* [MESOS-6193] - Make the docker/volume isolator nesting aware.

* [MESOS-6709] - Enable HTTP and TCP health checks on Windows.

* [MESOS-6714] - Port `slave_tests.cpp`.

* [MESOS-6733] - Windows: Enable authentication to the master.

* [MESOS-6894] - Checkpoint 'ContainerConfig' in Mesos Containerizer.

* [MESOS-7284] - Allow Mesos CLI to take masters IP.

* [MESOS-7285] - Implement a plugin to list container's on a given agent.

* [MESOS-7303] - Support Isolator capabilities.

* [MESOS-7305] - Adjust the recover logic of MesosContainerizer to allow standalone containers.

* [MESOS-7328] - Validate offer operations for converting disk resources.

* [MESOS-7388] - Update allocator interfaces to support resource providers.

* [MESOS-7443] - Add the MARK_AGENT_GONE call to the Operator v1 API protos.

* [MESOS-7444] - Add support for storing gone agents to the master registry.

* [MESOS-7445] - Implement the API handler on the master for marking agents as gone.

* [MESOS-7446] - Add authorization for the MARK_AGENT_GONE call.

* [MESOS-7448] - Add support for pruning the list of gone agents in the registry.

* [MESOS-7469] - Add resource provider driver.

* [MESOS-7491] - Build a CSI client to talk to a CSI plugin.

* [MESOS-7533] - Add a function stub for resource provider re-registration.

* [MESOS-7534] - Notify resource providers if they've been re-registered.

* [MESOS-7535] - Distinguish between active and inactive resource providers in RP Manager.

* [MESOS-7550] - Publish Local Resource Provider resources in the agent before container launch or update.

* [MESOS-7555] - Add resource provider IDs to the registry.

* [MESOS-7557] - Test that resource providers can re-register after agent fails over.

* [MESOS-7561] - Add storage resource provider specific information in ResourceProviderInfo.

* [MESOS-7578] - Write a proposal to make the I/O Switchboards optional.

* [MESOS-7594] - Implement 'apply' for resource provider related operations.

* [MESOS-7757] - Update master to handle updates to agent total resources.

* [MESOS-7790] - Design hierarchical quota allocation.

* [MESOS-7807] - Docker executor needs to return multiple IP addresses for the container.

* [MESOS-7892] - Filter results of `/state` on agent by role.

* [MESOS-7899] - Expose sandboxes using virtual paths and hide the agent work directory.

* [MESOS-7936] - Move sandbox path volume logic to 'volume/sandbox_path' isolator.

* [MESOS-7982] - Create Centos 6/7 RPM package.

* [MESOS-7985] - Use ASF CI for automating RPM packaging and upload to bintray.

* [MESOS-7992] - Enable OpenSSL build on Windows.

* [MESOS-8013] - Add test for blkio statistics.

* [MESOS-8032] - Launch CSI plugins in storage local resource provider.

* [MESOS-8050] - Mesos HTTP/HTTPS health checks for IPv6 docker containers.

* [MESOS-8060] - Introduce first class 'profile' for disk resources.

* [MESOS-8071] - Add agent capability for resource provider.

* [MESOS-8075] - Add ReadWriteLock to libprocess.

* [MESOS-8079] - Checkpoint and recover layers used to provision rootfs in provisioner.

* [MESOS-8086] - Update ACCEPT call handler in master for new operations.

* [MESOS-8087] - Add operation status update handler in Master.

* [MESOS-8088] - Introduce Lamport timestamp for offer operations.

* [MESOS-8089] - Add messages to publish resources on a resource provider.

* [MESOS-8097] - Add filesystem layout for local resource providers.

* [MESOS-8098] - Benchmark Master failover performance.

* [MESOS-8099] - Add protobuf for checkpointing resource provider states.

* [MESOS-8100] - Authorize standalone container calls from local resource providers.

* [MESOS-8101] - Import resources from CSI plugins in storage local resource provider.

* [MESOS-8102] - Add a test CSI plugin for storage local resource provider.

* [MESOS-8107] - Add a call to update total resources in the resource provider API.

* [MESOS-8108] - Process offer operations in storage local resource provider.

* [MESOS-8130] - Add placeholder handlers for offer operation feedback.

* [MESOS-8131] - Add new protobuf messages for offer operation feedback.

* [MESOS-8132] - Design a library to send offer operation status updates.

* [MESOS-8139] - Upgrade protobuf to 3.5.x.

* [MESOS-8141] - Add filesystem layout for storage resource providers.

* [MESOS-8143] - Publish and unpublish storage local resources through CSI plugins.

* [MESOS-8181] - Add tests that a failed offer operation on resource provider resources leads to a clock update.

* [MESOS-8183] - Add a container daemon to monitor a long-running standalone container.

* [MESOS-8186] - Implement the agent's AcknowledgeOfferOperationMessage handler.

* [MESOS-8187] - Enable LRP to send operation status updates, checkpoint, and retry using the SUM.

* [MESOS-8193] - Update master’s OfferOperationStatusUpdate handler to acknowledge updates to the agent if OfferOperationID is not set.

* [MESOS-8195] - Implement explicit offer operation reconciliation between the master, agent and RPs.

* [MESOS-8196] - Propagate failures from applying offer operations from resource providers.

* [MESOS-8197] - Implement a library to send offer operation status updates.

* [MESOS-8198] - Update the ReconcileOfferOperations protos.

* [MESOS-8199] - Add plumbing for explicit offer operation reconciliation between master, agent, and RPs.

* [MESOS-8207] - Reconcile offer operations between resource providers, agents, and master.

* [MESOS-8211] - Handle agent local resources in offer operation handler.

* [MESOS-8218] - Support `RESERVE`/`CREATE` operations with resource providers.

* [MESOS-8222] - Add resource versions to RunTaskMessage.

* [MESOS-8244] - Add operator API to reload local resource providers.

* [MESOS-8251] - Introduce a way to resolve the "profile" for disk resources.

* [MESOS-8265] - Add state recovery for storage local resource provider.

* [MESOS-8269] - Support resource provider re-subscription in the resource provider manager.

* [MESOS-8270] - Add an agent endpoint to list all active resource providers.

* [MESOS-8309] - Introduce a UUID message type.

* [MESOS-8375] - Use protobuf reflection to simplify upgrading of resources.

* [MESOS-8394] - Bump CSI to 0.1.0.

Release Notes - Mesos - Version 1.4.2 (WIP)

-------------------------------------------

* This is a bug fix release.

** Bug

* [MESOS-6616] - Error: dereferencing type-punned pointer will break strict-aliasing rules.

* [MESOS-7504] - Parent's mount namespace cannot be determined when launching a nested container.

* [MESOS-7975] - The command/default/docker executor can incorrectly send a TASK_FINISHED update even when the task is killed.

* [MESOS-8125] - Agent should properly handle recovering an executor when its pid is reused.

* [MESOS-8159] - ns::clone uses an async signal unsafe stack.

* [MESOS-8237] - Strip (Offer|Resource).allocation_info for non-MULTI_ROLE schedulers.

* [MESOS-8297] - Built-in driver-based executors ignore kill task if the task has not been launched.

* [MESOS-8356] - Persistent volume ownership is set to root despite of sandbox owner (frameworkInfo.user) when docker executor is used.

* [MESOS-8411] - Killing a queued task can lead to the command executor never terminating.

* [MESOS-8480] - Mesos returns high resource usage when killing a Docker task.

* [MESOS-8552] - CGROUPS_ROOT_PidNamespaceForward and CGROUPS_ROOT_PidNamespaceBackward tests fail.

* [MESOS-8569] - Allow newline characters when decoding base64 strings in stout.

Release Notes - Mesos - Version 1.4.1

-------------------------------------------

* This is a bug fix release.

** Bug

* [MESOS-7873] - Expose `ExecutorInfo.ContainerInfo.NetworkInfo` in Mesos `state` endpoint.

* [MESOS-7921] - ProcessManager::resume sometimes crashes accessing EventQueue.

* [MESOS-7964] - Heavy-duty GC makes the agent unresponsive.

* [MESOS-7968] - Handle `/proc/self/ns/pid_for_children` when parsing available namespace.

* [MESOS-7969] - Handle cgroups v2 hierarchy when parsing /proc/self/cgroups.

* [MESOS-7980] - Stout fails to compile with libc >= 2.26.

* [MESOS-8051] - Killing TASK_GROUP fail to kill some tasks.

* [MESOS-8080] - The default executor does not propagate missing task exit status correctly.

* [MESOS-8090] - Mesos 1.4.0 crashes with 1.3.x agent with oversubscription

* [MESOS-8135] - Masters can lose track of tasks' executor IDs.

* [MESOS-8169] - Incorrect master validation forces executor IDs to be globally unique.

Release Notes - Mesos - Version 1.4.0

-------------------------------------------

This release contains the following new features:

* [MESOS-5116] - The `disk/xfs` isolator now supports the

`--enforce_container_disk_quota` flag to efficiently measure disk

usage without enforcing usage constraints.

* [MESOS-6223] - Agents are now allowed to recover the agent ID

after a host reboot. See docs/upgrades.md for details.

* [MESOS-6375] - **Experimental** Support for hierarchical resource

allocation roles. Hierarchical roles allows delegation of resource

allocation policies (i.e. fair sharing and quota) further down the

hierarchy. For example, the "engineering" organization gets a 75%

share of the resources, but it's up to the operators within the

"engineering" organization to figure out how to fairly share between

the "engineering/backend" team and the "engineering/frontend" team.

The same delegation applies for quota. NOTE: There are known issues

related to hierarchical roles (e.g. hierarchical quota allocation

is not implemented and quota will be over-allocated if used with

hierarchical roles, see: MESOS-7402) and thus it is not recommended

for production usage at this time.

* [MESOS-7418, MESOS-7088] - File-based secrets are now supported for Mesos

and Universal containerizer. Image-pull secrets are supported for Docker

registry credentials.

* [MESOS-7477] - Linux ambient capabilites are now supported, so

frameworks can run tasks that use ambient capabilites to grant

limited additional privileged to tasks.

* [MESOS-7476, MESOS-7671] - Support for frameworks and operators

specifying Linux bounding capabilities in order to limit the

maximum privileges that a task may acquire.

Deprecations/Removals:

* [MESOS-7671] - LinuxInfo.capabilities is deprecated in favor

of LinuxInfo.effective_capabilities.

* [MESOS-7477] - The agent `--allowed_capabilities` flag is

deprecated in favor of `--effective_capabilities`

Unresolved Critical Issues:

* [MESOS-7643] - The order of isolators provided in '--isolation' flag is not preserved and instead sorted alphabetically

* [MESOS-7402] - Quota is over-allocated when used with hierarchical roles.

Additional API Changes:

* [MESOS-7755] The interpretation of the optional resource argument

passed in `Allocator::updateSlave` was changed from the total

amount of oversubscribed resources on the agent to the new total

resources (both revocable and non-revocable) on the agent. Custom

allocator implementation should be changed to interpretation of the

passed value as a total before updating.

Feature Graduations:

* [MESOS-2533] - Support HTTP checks in Mesos.

* [MESOS-3567] - Support TCP checks in Mesos.

All Resolved Issues:

** Bug

* [MESOS-1987] - Add support for SemVer build and prerelease labels to stout.

* [MESOS-4210] - Investigate increasing protobuf protocol message size limit.

* [MESOS-4331] - git commit-msg hook completely breaks fixup commits.

* [MESOS-4467] - Implement `sleep` in Windows

* [MESOS-4983] - Segfault in ProcessTest.Spawn with GCC 6

* [MESOS-4992] - sandbox uri does not work outisde mesos http server

* [MESOS-5187] - The filesystem/linux isolator does not set the permissions of the host_path.

* [MESOS-5903] - `GTEST_IS_THREADSAFE` guards prevent many tests from being run on Windows.

* [MESOS-5937] - `flags::parse` assumes the filesystem is rooted at '/'

* [MESOS-5938] - `net::links` is not implemented on Windows.

* [MESOS-6115] - Source tree contains compiled protobuf source

* [MESOS-6539] - Compile warning in GMock: "binding dereferenced null pointer to reference"

* [MESOS-6743] - Docker executor hangs forever if `docker stop` fails.

* [MESOS-6814] - Make sure compilation configuration is propagated correctly to third party dependencies

* [MESOS-6817] - Audit the use of UNICODE-related code paths

* [MESOS-6916] - Improve health checks validation.

* [MESOS-6950] - Launching two tasks with the same Docker image simultaneously may cause a staging dir never cleaned up

* [MESOS-6961] - Executors don't use glog for logging.

* [MESOS-7017] - HTTP API responses can crash the master.

* [MESOS-7115] - Agent should prefer LOG(FATAL) over EXIT().

* [MESOS-7173] - CMake does not define `GIT_SHA` etc. in build.cpp

* [MESOS-7186] - Metrics about used/allocated shared resources are incorrect accounted.

* [MESOS-7193] - Use of `GTEST_IS_THREADSAFE` in asserts is problematic.

* [MESOS-7252] - Need to fix resource check in long-lived framework

* [MESOS-7268] - CNI isolator should mount network related /etc/* files in readonly mode

* [MESOS-7351] - CMake < 3.8.0 cannot find VS2017 tools

* [MESOS-7373] - Remove thread_local workaround on OSX

* [MESOS-7374] - Running DOCKER images in Mesos Container Runtime without `linux/filesystem` isolation enabled renders host unusable

* [MESOS-7378] - Build failure with glibc 2.12.

* [MESOS-7381] - Flaky tests in NestedMesosContainerizerTest

* [MESOS-7389] - Mesos 1.2.0 crashes with pre-1.0 Mesos agents.

* [MESOS-7403] - Resources::apply(const Offer::Operation&) should fail when a shared persistent volume can't be removed

* [MESOS-7441] - RegisterSlaveValidationTest.DropInvalidRegistration is flaky

* [MESOS-7457] - HierarchicalAllocatorTest.NestedRoleQuota is flaky

* [MESOS-7458] - webui display of framework resources is confusing

* [MESOS-7459] - Fix the duration.hpp warning

* [MESOS-7462] - Flaky test HierarchicalAllocatorTest.NestedRoleDRF

* [MESOS-7464] - Recent Docker versions cannot be parsed by stout.

* [MESOS-7468] - Could not copy the sandbox path on WebUI

* [MESOS-7471] - Provisioner recover should not always assume 'rootfses' dir exists.

* [MESOS-7476] - Restrict capabilities to only the bounding set.

* [MESOS-7484] - VersionTest.ParseInvalid aborts on Windows.

* [MESOS-7496] - The /debug:fastlink linker option is not being respected

* [MESOS-7498] - Remove need to set environment variable `PreferredToolArchitecture`

* [MESOS-7502] - Build error on Windows when using "int" for a file descriptor

* [MESOS-7507] - Add a metric for the network size of replicas for the registry.

* [MESOS-7515] - MasterAllocatorTest/0.ResourcesUnused is flaky

* [MESOS-7524] - Basic fetcher success metrics

* [MESOS-7545] - Volume secret isolator breaks Windows build

* [MESOS-7552] - MasterAllocatorTest/0.FrameworkExited is flaky

* [MESOS-7569] - Allow "old" executors with half-open connections to be preserved during agent upgrade / restart.

* [MESOS-7581] - Specifying an unbundled dependency can cause build to pick up wrong Boost version

* [MESOS-7584] - ASF Jenkins build errors out on missing 'python-six' dependency

* [MESOS-7597] - libprocess build is broken

* [MESOS-7618] - CMake files incompatible with multi-configuration generators

* [MESOS-7627] - Mesos slave stucks

* [MESOS-7638] - The command `false` does not exist on Windows

* [MESOS-7640] - Docker containerizer fails to set sandbox logs ownership correctly.

* [MESOS-7652] - Docker image with universal containerizer does not work if WORKDIR is missing in the rootfs.

* [MESOS-7655] - Reservation Refinement: Update the resources logic.

* [MESOS-7662] - Documentation regarding TASK_LOST is misleading

* [MESOS-7666] - Update the agent to use the new resource format

* [MESOS-7667] - Update the master to use the new resource format.

* [MESOS-7669] - Update the test utilities to produce the resources in the new format

* [MESOS-7671] - Let frameworks specify the task bounding capabilities.

* [MESOS-7674] - Update the generic Protobuf to JSON facility to not output deprecated fields

* [MESOS-7679] - V1 Operator API update for reservation refinement.

* [MESOS-7689] - Libprocess can crash on malformed request paths for libprocess messages.

* [MESOS-7690] - The agent can crash when an unknown executor tries to register.

* [MESOS-7700] - Prevent reserve/create operations with refined reservations on non-capable agents.

* [MESOS-7703] - Mesos fails to exec a custom executor when no shell is used

* [MESOS-7711] - Master updates registry for reregistering agents even when they haven't been unreachable

* [MESOS-7714] - Fix agent downgrade for reservation refinement

* [MESOS-7716] - Mesos 1.2.0 agent crashes Mesos 1.4.0 master

* [MESOS-7725] - PersistentVolumeEndpointsTest.ReserveAndSlaveRemoval test is flaky

* [MESOS-7728] - Java HTTP adapter crashes JVM when leading master disconnects.

* [MESOS-7735] - The master crashes when state endpoint is hit during a task authorization.

* [MESOS-7744] - Mesos Agent Sends TASK_KILL status update to Master, and still launches task

* [MESOS-7751] - Mesos failed to build on Windows due to error C2039: 'parse': is not a member of 'mesos::internal::protobuf'

* [MESOS-7753] - `log.LearnedMessage` could be rejected due to being sent from '@0.0.0.0:0'

* [MESOS-7758] - Stout doesn't build standalone.

* [MESOS-7761] - Website ruby deps do not bundle on macOS

* [MESOS-7765] - MasterTest.KillUnknownTask is failling due to a bug in `net::IPv4::ANY()`

* [MESOS-7769] - libprocess initializes to bind to random port if --ip is not specified

* [MESOS-7770] - Persistent volume might not be mounted if there is a sandbox volume whose source is the same as the target of the persistent volume.

* [MESOS-7772] - Copy-n-paste error in slave/main.cpp

* [MESOS-7775] - Eliminate extra process abort in a subprocess watchdog

* [MESOS-7777] - Agent failed to recover due to mount namespace leakage in Docker 1.12/1.13

* [MESOS-7778] - Hide per-platform subprocess headers.

* [MESOS-7783] - Framework might not receive status update when a just launched task is killed immediately

* [MESOS-7794] - Mesos failed with error c2102 when build in conformance mode (/permissive-)

* [MESOS-7796] - LIBPROCESS_IP isn't passed on to the fetcher

* [MESOS-7797] - Hard-coded forward slash breaks windows docker container task in DC/OS

* [MESOS-7805] - mesos-execute has incorrect example TaskInfo in help string

* [MESOS-7817] - CreateProcess wrapper's error message is bad

* [MESOS-7821] - Resource refinement does downgrade task.executor.resources in LAUNCH_GROUP handler.

* [MESOS-7830] - Sandbox_path volume does not have ownership set correctly.

* [MESOS-7831] - Resource refinement is not applied to tasks in completed_frameworks.

* [MESOS-7849] - The rlimits and linux/capabilities isolators should support nested containers

* [MESOS-7858] - Launching a nested container with namespace/pid isolation, with glibc < 2.25, may deadlock the LinuxLauncher and MesosContainerizer

* [MESOS-7863] - Agent may drop pending kill task status updates.

* [MESOS-7865] - Agent may process a kill task and still launch the task.

* [MESOS-7869] - Build fails with `--disable-zlib` or `--with-zlib=DIR`

* [MESOS-7871] - Agent fails assertion during request to '/state'

* [MESOS-7872] - Scheduler hang when registration fails.

* [MESOS-7888] - Track fetcher task success and failures

* [MESOS-7909] - Ordering dependency between 'linux/capabilities' and 'docker/runtime' isolator.

* [MESOS-7912] - Master WebUI not working in Chrome.

* [MESOS-7921] - process::EventQueue sometimes crashes

* [MESOS-7922] - Fix communication between old masters and new agents.

* [MESOS-7926] - Abnormal termination of default executor can cause MesosContainerizer::destroy to fail.

* [MESOS-7934] - OOM due to LibeventSSLSocket send incorrectly returning 0 after shutdown.

** Documentation

* [MESOS-7246] - Add documentation for AGENT_ADDED/AGENT_REMOVED events.

* [MESOS-7349] - Document Mesos "check" feature.

* [MESOS-7501] - Change legacy --with-network-isolator to --with-port-mapping-isolator

** Epic

* [MESOS-6975] - Prevent pre-1.0 agents from registering with 1.3+ master.

* [MESOS-7088] - Support private registry credential per container.

* [MESOS-7623] - Automatically publish website through CI

** Improvement

* [MESOS-5116] - Add support for accounting only mode in XFS isolator.

* [MESOS-5417] - define WSTRINGIFY behaviour on Windows

* [MESOS-6053] - Combine test helpers into one single binary.

* [MESOS-6223] - Allow agents to re-register post a host reboot

* [MESOS-6535] - The default executor should support kill policies

* [MESOS-6549] - Asynchronous dir removal in agent GC

* [MESOS-6782] - Inherit Environment from parent container when launching DEBUG container.

* [MESOS-6905] - Task status updates caused by task health update do not set appropriate reason.

* [MESOS-6976] - Disallow (re-)registration attempts by old agents.

* [MESOS-6977] - Cleanup tech debt in master for old agents

* [MESOS-6978] - Update webui to remove orphan tasks

* [MESOS-7006] - Launch docker containers with --cpus instead of cpu-shares

* [MESOS-7015] - Frameworks should be able to (re)register in suppressed state

* [MESOS-7092] - Health checker duplicates a lot of checker's functionality.

* [MESOS-7228] - Upgrade Mesos to build with proto3.

* [MESOS-7327] - Add a test with multiple tasks and checks for the default executor.

* [MESOS-7343] - Add a ReviewBot for testing patches on Windows

* [MESOS-7355] - Set MESOS_SANDBOX in debug containers.

* [MESOS-7364] - Upgrade vendored GMock / GTest

* [MESOS-7401] - Optionally reject messages when UPIDs does not match IP.

* [MESOS-7418] - Add support for file-based secrets

* [MESOS-7429] - Allow isolators to inject task-specific environment variables.

* [MESOS-7451] - Expose MOUNT volumes of an agent in master's v0 HTTP API

* [MESOS-7477] - Support ambient capabilities.

* [MESOS-7540] - Add an agent flag for executor re-registration timeout.

* [MESOS-7542] - Add executor reconnection retry logic to the agent

* [MESOS-7572] - Attach latest symlink when executor is registered.

* [MESOS-7585] - Added 'mesos config show' command to the new Mesos CLI.

* [MESOS-7608] - Protobuf definitions for domains

* [MESOS-7609] - Protobuf definitions for region-aware framework capability

* [MESOS-7610] - Support domains in master and agent

* [MESOS-7611] - Prevent master from joining mixed-region cluster

* [MESOS-7612] - Prevent agent with misconfigured domain from registering

* [MESOS-7614] - Only offer resources on remote agents to region-aware frameworks

* [MESOS-7630] - Add simple filtering to unversioned operator API

* [MESOS-7644] - Add DomainInfo to offers

* [MESOS-7782] - Add fetcher cache size metrics.

* [MESOS-7792] - Add support for ECDH ciphers

* [MESOS-7808] - Bundling gRPC into 3rdparty

* [MESOS-7809] - Building gRPC with Autotools

* [MESOS-7810] - gRPC support in libprocess

* [MESOS-7814] - Improve the test frameworks.

* [MESOS-7862] - Get rid of timestamp and date in generated javadoc files

* [MESOS-7870] - Refactor libssl and libcrypto checks for building gRPC

* [MESOS-7881] - Building gRPC with CMake

** Task

* [MESOS-6101] - Add Framwork events to master's operator API

* [MESOS-6162] - Add support for cgroups blkio subsystem blkio statistics.

* [MESOS-6441] - Display reservations in the agent page in the webui.

* [MESOS-7149] - Support reservations for role subtrees

* [MESOS-7283] - Add ability to initialize a test cluster for Mesos CLI unit-test infrastructure

* [MESOS-7304] - Fetcher should not depend on SlaveID.

* [MESOS-7315] - Design doc for resource provider and storage integration.

* [MESOS-7414] - Enable authorization for master's logging API calls: GET_LOGGING_LEVEL and SET_LOGGING_LEVEL

* [MESOS-7415] - Add authorization to master's operator maintenance API in v0 and v1

* [MESOS-7416] - Filter results of `/master/slaves` and the v1 call GET_AGENTS

* [MESOS-7417] - Design doc for file-based secrets.

* [MESOS-7433] - Set working directory in DEBUG containers.

* [MESOS-7449] - Refactor containerizers to not depend on TaskInfo or ExecutorInfo

* [MESOS-7488] - Add `--ip6` and `--ip6_discovery_command` flag to Mesos agent

* [MESOS-7505] - Enable hierarchical roles

* [MESOS-7560] - Add 'type' and 'name' to ResourceProviderInfo.

* [MESOS-7571] - Add `--resource_provider_config_dir` flag to the agent.

* [MESOS-7576] - Add master flag `--filter-gpu-resources={true|false}`

* [MESOS-7582] - Add Config class to manage the Mesos CLI config file.

* [MESOS-7591] - Update master to use resource provider IDs instead of agent ID in allocator calls.

* [MESOS-7593] - Update offer handling in the master to consider local resource providers

* [MESOS-7624] - Move website from svn to git

* [MESOS-7625] - Create script to automate publishing website

* [MESOS-7626] - Create a CI job to publish the website

* [MESOS-7631] - DefautlExecutor needs to inform tasks about IP addresses

* [MESOS-7632] - Add `HIERARCHICAL_ROLE` agent capability

* [MESOS-7633] - Prevent hierarchical roles from being allocated resources from non-HIERARCHICAL_ROLE agents.

* [MESOS-7665] - V0 Operator API update for reservation refinement.

* [MESOS-7668] - Update authorization to handle reservation refinement.

* [MESOS-7696] - Update resource provider design in the master

* [MESOS-7709] - Add --default_container_dns flag to the agent.

* [MESOS-7713] - Optimize number of copies made in dispatch/defer mechanism

* [MESOS-7755] - Update allocator to support updating agent total resources

* [MESOS-7757] - Update master to handle updates to agent total resources

* [MESOS-7767] - Make `net::IP` fields protected to allow for inheritance

* [MESOS-7780] - Add `SUBSCRIBE` call handling to the resource provider manager

* [MESOS-7806] - Add copy assignment operator to `net::IP::Network`

* [MESOS-7853] - Support shared PID namespace.

* [MESOS-7879] - The kill nested container call should provide ability to specify a signal.

Release Notes - Mesos - Version 1.3.3 (WIP)

-------------------------------------------

* This is a bug fix release.

All Issues:

** Bug

* [MESOS-8411] - Killing a queued task can lead to the command executor never terminating.

* [MESOS-8125] - Agent should properly handle recovering an executor when its pid is reused.

* [MESOS-8480] - Mesos returns high resource usage when killing a Docker task.

* [MESOS-8552] - CGROUPS_ROOT_PidNamespaceForward and CGROUPS_ROOT_PidNamespaceBackward tests fail.

Release Notes - Mesos - Version 1.3.2

-------------------------------------

* This is a bug fix release.

All Issues:

** Bug

* [MESOS-6743] - Docker executor hangs forever if `docker stop` fails.

* [MESOS-6950] - Launching two tasks with the same Docker image simultaneously may cause a staging dir never cleaned up.

* [MESOS-7652] - Docker image with universal containerizer does not work if WORKDIR is missing in the rootfs.

* [MESOS-7674] - Update the generic Protobuf to JSON facility to not output deprecated fields.

* [MESOS-7858] - Launching a nested container with namespace/pid isolation, with glibc < 2.25, may deadlock the LinuxLauncher and MesosContainerizer.

* [MESOS-7863] - Agent may drop pending kill task status updates.

* [MESOS-7865] - Agent may process a kill task and still launch the task.

* [MESOS-7872] - Scheduler hang when registration fails.

* [MESOS-7909] - Ordering dependency between 'linux/capabilities' and 'docker/runtime' isolator.

* [MESOS-7912] - Master WebUI not working in Chrome.

* [MESOS-7926] - Abnormal termination of default executor can cause MesosContainerizer::destroy to fail.

* [MESOS-7934] - OOM due to LibeventSSLSocket send incorrectly returning 0 after shutdown.

* [MESOS-8135] - Masters can lose track of tasks' executor IDs.

* [MESOS-8237] - Strip (Offer|Resource).allocation_info for non-MULTI_ROLE schedulers.

* [MESOS-8356] - Persistent volume ownership is set to root despite of sandbox owner (frameworkInfo.user) when docker executor is used.

Release Notes - Mesos - Version 1.3.1

-------------------------------------

* This is a bug fix release.

All Issues:

** Bug

* [MESOS-5187] - The filesystem/linux isolator does not set the permissions of the host_path.

* [MESOS-7252] - Need to fix resource check in long-lived framework.

* [MESOS-7429] - Allow isolators to inject task-specific environment variables.

* [MESOS-7540] - Add an agent flag for executor re-registration timeout.

* [MESOS-7546] - WAIT_NESTED_CONTAINER sometimes returns 404.

* [MESOS-7569] - Allow "old" executors with half-open connections to be preserved during agent upgrade / restart.

* [MESOS-7581] - Fix interference of external Boost installations when using some unbundled dependencies.

* [MESOS-7689] - Libprocess can crash on malformed request paths for libprocess messages.

* [MESOS-7690] - The agent can crash when an unknown executor tries to register.

* [MESOS-7692] - Default environment variables defined in Docker image are not available in Mesos containerizer.

* [MESOS-7703] - Mesos fails to exec a custom executor when no shell is used.

* [MESOS-7728] - Java HTTP adapter crashes JVM when leading master disconnects.

* [MESOS-7770] - Persistent volume might not be mounted if there is a sandbox volume whose source is the same as the target of the persistent volume.

* [MESOS-7777] - Agent failed to recover due to mount namespace leakage in Docker 1.12/1.13.

* [MESOS-7796] - LIBPROCESS_IP isn't passed on to the fetcher.

* [MESOS-7830] - Sandbox_path volume does not have ownership set correctly.

Release Notes - Mesos - Version 1.3.0

-------------------------------------

This release contains the following new features:

* [MESOS-1763] - Support for frameworks to receive resources for multiple

roles. This allows "multi-user" frameworks to leverage the role-based

resource allocation in mesos. Prior to this support, one had to run

multiple instances of a single-user framework to achieve multi-user

resource allocation, or implement multi-user resource allocation in

the framework.

* [MESOS-6365] - Authentication and authorization support for HTTP executors.

A new `--authenticate_http_executors` agent flag enables required

authentication on the HTTP executor API. A new `--executor_secret_key` flag

sets a key file to be used when generating and authenticating default tokens

that are passed to HTTP executors. Note that enabling these flags after

upgrade is disruptive to HTTP executors that were launched before the

upgrade; see 'docs/authentication.md' for more information on these flags

and the recommended upgrade procedure. Implicit authorization rules have

been added which allow an authenticated executor to make executor API calls

as that executor and make operator API calls which affect that executor's

container. See 'docs/authorization.md' for more information on these

implicit authorization rules.

* [MESOS-6627] - Support for frameworks to modify the role(s) they are

subscribed to. This is essential to supporting "multi-user" frameworks

(see MESOS-1763) in that roles are expected to come and go over time

(e.g. new employees join, new teams are formed, employees leave, teams

are disbanded, etc).

**NOTE**: In Mesos 1.3.0, the master will no longer allow 0.x agents to

register. Interoperability between 1.1+ masters and 0.x agents has never

been supported; however, it was not explicitly disallowed, either.

Starting with this release of Mesos, registration attempts by 0.x Mesos

agents will be ignored.

Deprecations/Removals:

* [MESOS-7259] - Remove deprecated ACLs `SetQuota` and `RemoveQuota`.

This change is only applicable to the local authorizer since internally

these acls were being translated to the `UPDATE_QUOTA` action.

* [MESOS-7320] - Remove deprecated ACL `ShutdownFramework`.

This change is only applicable to the local authorizer since internally

these acls were being translated to the `TEARDOWN_FRAMEWORK` action.

Unresolved Critical Issues:

* [MESOS-1625] - Extra trailing CRLF being sent after the HTTP body in libprocess.

* [MESOS-1718] - Command executor can overcommit the agent.

* [MESOS-2554] - Slave flaps when using --slave_subsystems that are not used for isolation.

* [MESOS-2774] - SIGSEGV received during process::MessageEncoder::encode().

* [MESOS-2842] - Update FrameworkInfo.principal on framework re-registration.

* [MESOS-3533] - Unable to find and run URIs files.

* [MESOS-3747] - HTTP Scheduler API no longer allows FrameworkInfo.user to be empty string.

* [MESOS-3794] - Master should not store arbitrarily sized data in ExecutorInfo.

* [MESOS-4259] - mesos HA can't delete the the redundant container on failure slave node.

* [MESOS-4297] - Executor does not shutdown when framework teardown.

* [MESOS-4642] - Mesos Agent Json API can dump binary data from log files out as invalid JSON.

* [MESOS-4996] - 'containerizer->update' will always fail after killing a docker container.

* [MESOS-5352] - Docker volume isolator cleanup can be blocked by first cleanup failure.

* [MESOS-5396] - After failover, master does not remove agents with same UPID.

* [MESOS-5849] - Agent sandboxes on Windows surpass the 260 character path length limit.

* [MESOS-5859] - Some tasks are always in staged state.

* [MESOS-5989] - Libevent SSL Socket downgrade code accesses uninitialized memory / assumes single peek is sufficient.

* [MESOS-5995] - Protobuf JSON deserialisation does not accept numbers formated as strings.

* [MESOS-6356] - ASF CI has interleaved logging.

* [MESOS-6615] - Running mesos-slave in the docker that leave many zombie process.

* [MESOS-6623] - Re-enable tests impacted by request streaming support.

* [MESOS-6632] - ContainerLogger might leak FD if container launch fails.

* [MESOS-6780] - ContentType/AgentAPIStreamingTest.AttachContainerInput test fails reliably.

* [MESOS-6784] - IOSwitchboardTest.KillSwitchboardContainerDestroyed is flaky.

* [MESOS-6804] - Running 'tty' inside a debug container that has a tty reports "Not a tty".

* [MESOS-6843] - Fetcher should not assume stdout/stderr in the sandbox.

* [MESOS-6913] - AgentAPIStreamingTest.AttachInputToNestedContainerSession fails on Mac OS.

* [MESOS-6974] - DefaultExecutorTest.CommitSuicideOnTaskFailure test is flaky.

* [MESOS-6986] - `abort` in `DRFSorter::add`.

* [MESOS-7017] - HTTP API responses can crash the master.

* [MESOS-7082] - ROOT_DOCKER_DockerAndMesosContainerizers/DefaultExecutorTest.KillTask/0 is flaky.

* [MESOS-7099] - Quota can be exceeded due to coarse-grained offer technique.

* [MESOS-7215] - Race condition on re-registration of non-partition-aware frameworks.

* [MESOS-7298] - Fetcher caches files with world-readable permissions.

* [MESOS-7362] - GPU support can't work when run spark.

* [MESOS-7374] - Running DOCKER images in Mesos Container Runtime without `linux/filesystem` isolation enabled renders host unusable.

* [MESOS-7381] - Flaky tests in NestedMesosContainerizerTest.

* [MESOS-7386] - Executor not cleaning up existing running docker containers if external logrotate/logger processes die/killed.

Feature Graduations:

* [MESOS-2449] - Support group of tasks (Pod) constructs and API in Mesos.

* [MESOS-4641] - Support Container Network Interface (CNI).

* [MESOS-6419] - Teardown unregistered frameworks.

All Experimental Features:

* [MESOS-2533] - Support HTTP checks in Mesos.

* [MESOS-3094] - Mesos on Windows.

* [MESOS-3421] - Support sharing of resources across task instances.

* [MESOS-3567] - Support TCP checks in Mesos.

* [MESOS-4312] - Porting Mesos on Power (ppc64le).

* [MESOS-4355] - Implement isolator for Docker volume.

* [MESOS-4791] - Operator API v1.

* [MESOS-4828] - XFS disk quota isolator.

* [MESOS-5275] - Add capabilities support for mesos containerizer.

* [MESOS-5344] - Partition-aware Mesos frameworks.

* [MESOS-5788] - Added JAVA API adapter for seamless transition to new scheduler API.

* [MESOS-5931] - Support auto backend in Mesos Containerizer.

* [MESOS-6014] - Added port mapping CNI plugin.

* [MESOS-6077] - Added a default (task group) executor.

* [MESOS-6402] - rlimit support for Mesos containerizer.

* [MESOS-6460] - Container Attach/Exec.

* [MESOS-6758] - Support docker registry that requires basic auth.

* [MESOS-6906] - Introduce a general non-interpreting task check.

All Resolved Issues:

** Bug

* [MESOS-1987] - Add support for SemVer build and prerelease labels to stout.

* [MESOS-4245] - Add `dist` target to CMake solution.

* [MESOS-4263] - Report volume usage through ResourceStatistics.

* [MESOS-5028] - Copy provisioner cannot replace directory with symlink.

* [MESOS-5172] - Registry puller cannot fetch blobs correctly from http Redirect 3xx urls.

* [MESOS-5288] - Update leveldb patch file to suport s390x.

* [MESOS-5880] - Semantics of `environment` differ across Windows and POSIX.

* [MESOS-6134] - Port CFS quota support to Docker Containerizer using command executor.

* [MESOS-6138] - Add 'syntax=proto2' to all .proto files in Mesos.

* [MESOS-6327] - Large docker images causes container launch failures: Too many levels of symbolic links.

* [MESOS-6560] - The default stout stringify always copies its argument.

* [MESOS-6606] - Reject optimized builds with libcxx before 3.9.

* [MESOS-6720] - Check that `PreferredToolArchitecture` is set to `x64` on Windows before building.

* [MESOS-6730] - Reserve operation should validate reserved resource role against resource allocationInfo role.

* [MESOS-6731] - Create a test filter for stout tests that use `symlink` on Windows, as they will fail if not run as admin.

* [MESOS-6732] - XFS disk isolator should check whether quotas are enabled.

* [MESOS-6742] - Adding support for s390x architecture.

* [MESOS-6815] - Enable glog stack traces when we call things like `ABORT` on Windows.