2019-10-24 15:13:19,542 INFO org.apache.flink.mesos.entrypoint.MesosTaskExecutorRunner - -------------------------------------------------------------------------------- 2019-10-24 15:13:19,544 INFO org.apache.flink.mesos.entrypoint.MesosTaskExecutorRunner - Starting MesosTaskExecutorRunner (Version: 1.9.1, Rev:4d56de8, Date:30.09.2019 @ 11:32:19 CST) 2019-10-24 15:13:19,544 INFO org.apache.flink.mesos.entrypoint.MesosTaskExecutorRunner - OS current user: root 2019-10-24 15:13:19,936 WARN org.apache.hadoop.util.NativeCodeLoader - Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 2019-10-24 15:13:20,002 INFO org.apache.flink.mesos.entrypoint.MesosTaskExecutorRunner - Current Hadoop/Kerberos user: flink 2019-10-24 15:13:20,002 INFO org.apache.flink.mesos.entrypoint.MesosTaskExecutorRunner - JVM: OpenJDK 64-Bit Server VM - Oracle Corporation - 1.8/25.222-b10 2019-10-24 15:13:20,002 INFO org.apache.flink.mesos.entrypoint.MesosTaskExecutorRunner - Maximum heap size: 348 MiBytes 2019-10-24 15:13:20,002 INFO org.apache.flink.mesos.entrypoint.MesosTaskExecutorRunner - JAVA_HOME: (not set) 2019-10-24 15:13:20,005 INFO org.apache.flink.mesos.entrypoint.MesosTaskExecutorRunner - Hadoop version: 2.8.3 2019-10-24 15:13:20,005 INFO org.apache.flink.mesos.entrypoint.MesosTaskExecutorRunner - JVM Options: 2019-10-24 15:13:20,005 INFO org.apache.flink.mesos.entrypoint.MesosTaskExecutorRunner - -Xms360m 2019-10-24 15:13:20,005 INFO org.apache.flink.mesos.entrypoint.MesosTaskExecutorRunner - -Xmx360m 2019-10-24 15:13:20,005 INFO org.apache.flink.mesos.entrypoint.MesosTaskExecutorRunner - -XX:MaxDirectMemorySize=664m 2019-10-24 15:13:20,006 INFO org.apache.flink.mesos.entrypoint.MesosTaskExecutorRunner - -Dlog.file=flink-taskmanager.log 2019-10-24 15:13:20,006 INFO org.apache.flink.mesos.entrypoint.MesosTaskExecutorRunner - -Dlog4j.configuration=file:/usr/local/lib/flink-1.9.1/conf/log4j.properties 2019-10-24 15:13:20,006 INFO org.apache.flink.mesos.entrypoint.MesosTaskExecutorRunner - -Dlogback.configurationFile=file:/usr/local/lib/flink-1.9.1/conf/logback.xml 2019-10-24 15:13:20,006 INFO org.apache.flink.mesos.entrypoint.MesosTaskExecutorRunner - Program Arguments: 2019-10-24 15:13:20,006 INFO org.apache.flink.mesos.entrypoint.MesosTaskExecutorRunner - -Dtaskmanager.data.port=31000 2019-10-24 15:13:20,006 INFO org.apache.flink.mesos.entrypoint.MesosTaskExecutorRunner - -Dtaskmanager.rpc.port=31001 2019-10-24 15:13:20,006 INFO org.apache.flink.mesos.entrypoint.MesosTaskExecutorRunner - Classpath: /usr/local/lib/flink-1.9.1/lib/flink-avro-1.9.1.jar:/usr/local/lib/flink-1.9.1/lib/flink-csv-1.9.1.jar:/usr/local/lib/flink-1.9.1/lib/flink-json-1.9.1.jar:/usr/local/lib/flink-1.9.1/lib/flink-shaded-hadoop-2-uber-2.8.3-7.0.jar:/usr/local/lib/flink-1.9.1/lib/flink-table-blink_2.11-1.9.1.jar:/usr/local/lib/flink-1.9.1/lib/flink-table_2.11-1.9.1.jar:/usr/local/lib/flink-1.9.1/lib/log4j-1.2.17.jar:/usr/local/lib/flink-1.9.1/lib/slf4j-log4j12-1.7.15.jar:/usr/local/lib/flink-1.9.1/lib/flink-dist_2.11-1.9.1.jar::: 2019-10-24 15:13:20,006 INFO org.apache.flink.mesos.entrypoint.MesosTaskExecutorRunner - -------------------------------------------------------------------------------- 2019-10-24 15:13:20,007 INFO org.apache.flink.mesos.entrypoint.MesosTaskExecutorRunner - Registered UNIX signal handlers for [TERM, HUP, INT] 2019-10-24 15:13:20,017 DEBUG org.apache.flink.mesos.entrypoint.MesosTaskExecutorRunner - Mesos dynamic properties: {taskmanager.data.port=31000, taskmanager.rpc.port=31001} 2019-10-24 15:13:20,020 INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: jobmanager.rpc.address, 192.168.10.11 2019-10-24 15:13:20,020 INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: jobmanager.rpc.port, 6123 2019-10-24 15:13:20,020 INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: jobmanager.heap.size, 1024m 2019-10-24 15:13:20,020 INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: taskmanager.heap.size, 1024m 2019-10-24 15:13:20,021 INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: taskmanager.numberOfTaskSlots, 1 2019-10-24 15:13:20,021 INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: parallelism.default, 1 2019-10-24 15:13:20,021 INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: state.checkpoints.dir, file:///var/lib/flink/data/ckeckpoints 2019-10-24 15:13:20,021 INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: state.savepoints.dir, file:///var/lib/flink/data/savepoints 2019-10-24 15:13:20,021 INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: jobmanager.execution.failover-strategy, region 2019-10-24 15:13:20,021 INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: rest.port, 8081 2019-10-24 15:13:20,021 INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: rest.bind-address, 0.0.0.0 2019-10-24 15:13:20,022 INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: jobmanager.archive.fs.dir, file:///var/lib/flink/completed_jobs/ 2019-10-24 15:13:20,022 INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: historyserver.archive.fs.dir, file:///var/lib/flink/completed_jobs/ 2019-10-24 15:13:20,022 INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: mesos.resourcemanager.tasks.container.type, docker 2019-10-24 15:13:20,022 INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: mesos.resourcemanager.tasks.container.image.name, eskimo:flink-worker 2019-10-24 15:13:20,022 INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: mesos.resourcemanager.tasks.bootstrap-cmd, export FLINK_HOME=/usr/local/lib/flink/ 2019-10-24 15:13:20,022 INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: mesos.resourcemanager.tasks.container.volumes, /var/log/flink:/var/log/flink:RW,/var/lib/flink:/var/lib/flink:RW,/etc:/host_etc:RO 2019-10-24 15:13:20,023 INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: mesos.resourcemanager.tasks.cpus, 1 2019-10-24 15:13:20,023 INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: mesos.resourcemanager.tasks.mem, 1024 2019-10-24 15:13:20,023 INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: resourcemanager.taskmanager-timeout, 1800000 2019-10-24 15:13:20,023 INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: taskmanager.host, 192.168.10.14 2019-10-24 15:13:20,055 DEBUG org.apache.flink.core.fs.FileSystem - Loading extension file systems via services 2019-10-24 15:13:20,056 DEBUG org.apache.flink.core.fs.FileSystem - Added file system maprfs:org.apache.flink.runtime.fs.maprfs.MapRFsFactory 2019-10-24 15:13:20,065 INFO org.apache.flink.mesos.entrypoint.MesosTaskExecutorRunner - ResourceID assigned for this container: taskmanager-00001 2019-10-24 15:13:20,076 DEBUG org.apache.flink.runtime.util.HadoopUtils - Cannot find hdfs-default configuration-file path in Flink config. 2019-10-24 15:13:20,076 DEBUG org.apache.flink.runtime.util.HadoopUtils - Cannot find hdfs-site configuration-file path in Flink config. 2019-10-24 15:13:20,076 DEBUG org.apache.flink.runtime.util.HadoopUtils - Could not find Hadoop configuration via any of the supported methods (Flink configuration, environment variables). 2019-10-24 15:13:20,123 INFO org.apache.flink.runtime.security.modules.HadoopModule - Hadoop user set to flink (auth:SIMPLE) 2019-10-24 15:13:20,284 INFO org.apache.flink.configuration.Configuration - Config uses fallback configuration key 'jobmanager.rpc.address' instead of key 'rest.address' 2019-10-24 15:13:20,287 INFO org.apache.flink.runtime.taskexecutor.TaskManagerRunner - Using configured hostname/address for TaskManager: 192.168.10.14. 2019-10-24 15:13:20,288 INFO org.apache.flink.runtime.rpc.akka.AkkaRpcServiceUtils - Trying to start actor system at 192.168.10.14:31001 2019-10-24 15:13:20,347 DEBUG org.apache.flink.runtime.rpc.akka.AkkaRpcServiceUtils - Using akka configuration Config(SimpleConfigObject({"akka":{"actor":{"default-dispatcher":{"executor":"fork-join-executor","fork-join-executor":{"parallelism-factor":2,"parallelism-max":64,"parallelism-min":8},"throughput":15},"guardian-supervisor-strategy":"org.apache.flink.runtime.akka.StoppingSupervisorWithoutLoggingActorKilledExceptionStrategy","provider":"akka.remote.RemoteActorRefProvider","warn-about-java-serializer-usage":"off"},"daemonic":"off","jvm-exit-on-fatal-error":"on","log-config-on-start":"off","log-dead-letters":"off","log-dead-letters-during-shutdown":"off","loggers":["akka.event.slf4j.Slf4jLogger"],"logging-filter":"akka.event.slf4j.Slf4jLoggingFilter","loglevel":"DEBUG","remote":{"log-remote-lifecycle-events":"off","netty":{"tcp":{"bind-hostname":"0.0.0.0","bind-port":31001,"client-socket-worker-pool":{"pool-size-factor":1,"pool-size-max":2,"pool-size-min":1},"connection-timeout":"20 s","hostname":"192.168.10.14","maximum-frame-size":"10485760b","port":31001,"server-socket-worker-pool":{"pool-size-factor":1,"pool-size-max":2,"pool-size-min":1},"tcp-nodelay":"on","transport-class":"akka.remote.transport.netty.NettyTransport"}},"retry-gate-closed-for":"50 ms","startup-timeout":"100 seconds","transport-failure-detector":{"acceptable-heartbeat-pause":"6000 s","heartbeat-interval":"1000 s","threshold":300},"watch-failure-detector":{"acceptable-heartbeat-pause":"60 s","heartbeat-interval":"10 s","threshold":12}},"serialize-messages":"off","stdout-loglevel":"OFF"}})) 2019-10-24 15:13:20,684 INFO akka.event.slf4j.Slf4jLogger - Slf4jLogger started 2019-10-24 15:13:20,741 INFO akka.remote.Remoting - Starting remoting 2019-10-24 15:13:20,784 DEBUG org.apache.flink.shaded.akka.org.jboss.netty.channel.socket.nio.SelectorUtil - Using select timeout of 500 2019-10-24 15:13:20,784 DEBUG org.apache.flink.shaded.akka.org.jboss.netty.channel.socket.nio.SelectorUtil - Epoll-bug workaround enabled = false 2019-10-24 15:13:20,871 INFO akka.remote.Remoting - Remoting started; listening on addresses :[akka.tcp://flink@192.168.10.14:31001] 2019-10-24 15:13:20,943 INFO org.apache.flink.runtime.rpc.akka.AkkaRpcServiceUtils - Actor system started at akka.tcp://flink@192.168.10.14:31001 2019-10-24 15:13:20,956 INFO org.apache.flink.runtime.metrics.MetricRegistryImpl - No metrics reporter configured, no metrics will be exposed/reported. 2019-10-24 15:13:20,958 INFO org.apache.flink.runtime.rpc.akka.AkkaRpcServiceUtils - Trying to start actor system at 192.168.10.14:0 2019-10-24 15:13:20,960 DEBUG org.apache.flink.runtime.rpc.akka.AkkaRpcServiceUtils - Using akka configuration Config(SimpleConfigObject({"akka":{"actor":{"default-dispatcher":{"executor":"thread-pool-executor","thread-pool-executor":{"core-pool-size-max":1,"core-pool-size-min":1},"thread-priority":1,"throughput":15,"type":"akka.dispatch.PriorityThreadsDispatcher"},"guardian-supervisor-strategy":"org.apache.flink.runtime.akka.StoppingSupervisorWithoutLoggingActorKilledExceptionStrategy","provider":"akka.remote.RemoteActorRefProvider","warn-about-java-serializer-usage":"off"},"daemonic":"off","jvm-exit-on-fatal-error":"on","log-config-on-start":"off","log-dead-letters":"off","log-dead-letters-during-shutdown":"off","loggers":["akka.event.slf4j.Slf4jLogger"],"logging-filter":"akka.event.slf4j.Slf4jLoggingFilter","loglevel":"DEBUG","remote":{"log-remote-lifecycle-events":"off","netty":{"tcp":{"bind-hostname":"0.0.0.0","bind-port":0,"client-socket-worker-pool":{"pool-size-factor":1,"pool-size-max":2,"pool-size-min":1},"connection-timeout":"20 s","hostname":"192.168.10.14","maximum-frame-size":"10485760b","port":0,"server-socket-worker-pool":{"pool-size-factor":1,"pool-size-max":2,"pool-size-min":1},"tcp-nodelay":"on","transport-class":"akka.remote.transport.netty.NettyTransport"}},"retry-gate-closed-for":"50 ms","startup-timeout":"100 seconds","transport-failure-detector":{"acceptable-heartbeat-pause":"6000 s","heartbeat-interval":"1000 s","threshold":300},"watch-failure-detector":{"acceptable-heartbeat-pause":"60 s","heartbeat-interval":"10 s","threshold":12}},"serialize-messages":"off","stdout-loglevel":"OFF"}})) 2019-10-24 15:13:20,981 INFO akka.event.slf4j.Slf4jLogger - Slf4jLogger started 2019-10-24 15:13:20,984 INFO akka.remote.Remoting - Starting remoting 2019-10-24 15:13:21,005 INFO akka.remote.Remoting - Remoting started; listening on addresses :[akka.tcp://flink-metrics@192.168.10.14:32931] 2019-10-24 15:13:21,012 INFO org.apache.flink.runtime.rpc.akka.AkkaRpcServiceUtils - Actor system started at akka.tcp://flink-metrics@192.168.10.14:32931 2019-10-24 15:13:21,022 INFO org.apache.flink.runtime.rpc.akka.AkkaRpcService - Starting RPC endpoint for org.apache.flink.runtime.metrics.dump.MetricQueryService at akka://flink-metrics/user/MetricQueryService_taskmanager-00001 . 2019-10-24 15:13:21,033 INFO org.apache.flink.runtime.blob.PermanentBlobCache - Created BLOB cache storage directory /tmp/blobStore-19bcab9b-2922-484a-80b4-88fb85835ae1 2019-10-24 15:13:21,037 INFO org.apache.flink.runtime.blob.TransientBlobCache - Created BLOB cache storage directory /tmp/blobStore-b17aee62-b9a6-4ebd-906e-2d8cae786107 2019-10-24 15:13:21,038 INFO org.apache.flink.runtime.taskexecutor.TaskManagerRunner - Starting TaskManager with ResourceID: taskmanager-00001 2019-10-24 15:13:21,090 WARN org.apache.flink.runtime.taskmanager.TaskManagerLocation - No hostname could be resolved for the IP address 192.168.10.14, using IP address as host name. Local input split assignment (such as for HDFS files) may be impacted. 2019-10-24 15:13:21,183 INFO org.apache.flink.runtime.taskexecutor.TaskManagerServices - Temporary file directory '/tmp': total 39 GB, usable 28 GB (71.79% usable) 2019-10-24 15:13:21,185 INFO org.apache.flink.runtime.io.disk.FileChannelManagerImpl - FileChannelManager uses directory /tmp/flink-io-1da46916-e6af-40e0-a9cc-e769df987372 for spill files. 2019-10-24 15:13:21,200 INFO org.apache.flink.runtime.io.network.netty.NettyConfig - NettyConfig [server address: /192.168.10.14, server port: 31000, ssl enabled: false, memory segment size (bytes): 32768, transport type: NIO, number of server threads: 1 (manual), number of client threads: 1 (manual), server connect backlog: 0 (use Netty's default), client connect timeout (sec): 120, send/receive buffer size (bytes): 0 (use Netty's default)] 2019-10-24 15:13:21,202 INFO org.apache.flink.runtime.io.disk.FileChannelManagerImpl - FileChannelManager uses directory /tmp/flink-netty-shuffle-398b36f6-bf47-4c90-9740-2e07bb0c0823 for spill files. 2019-10-24 15:13:21,219 DEBUG org.apache.flink.shaded.netty4.io.netty.util.internal.logging.InternalLoggerFactory - Using SLF4J as the default logging framework 2019-10-24 15:13:21,220 DEBUG org.apache.flink.shaded.netty4.io.netty.util.ResourceLeakDetector - -Dorg.apache.flink.shaded.netty4.io.netty.leakDetection.level: simple 2019-10-24 15:13:21,220 DEBUG org.apache.flink.shaded.netty4.io.netty.util.ResourceLeakDetector - -Dorg.apache.flink.shaded.netty4.io.netty.leakDetection.targetRecords: 4 2019-10-24 15:13:21,239 DEBUG org.apache.flink.shaded.netty4.io.netty.util.internal.PlatformDependent0 - -Dio.netty.noUnsafe: false 2019-10-24 15:13:21,240 DEBUG org.apache.flink.shaded.netty4.io.netty.util.internal.PlatformDependent0 - Java version: 8 2019-10-24 15:13:21,240 DEBUG org.apache.flink.shaded.netty4.io.netty.util.internal.PlatformDependent0 - sun.misc.Unsafe.theUnsafe: available 2019-10-24 15:13:21,240 DEBUG org.apache.flink.shaded.netty4.io.netty.util.internal.PlatformDependent0 - sun.misc.Unsafe.copyMemory: available 2019-10-24 15:13:21,241 DEBUG org.apache.flink.shaded.netty4.io.netty.util.internal.PlatformDependent0 - java.nio.Buffer.address: available 2019-10-24 15:13:21,241 DEBUG org.apache.flink.shaded.netty4.io.netty.util.internal.PlatformDependent0 - direct buffer constructor: available 2019-10-24 15:13:21,243 DEBUG org.apache.flink.shaded.netty4.io.netty.util.internal.PlatformDependent0 - java.nio.Bits.unaligned: available, true 2019-10-24 15:13:21,243 DEBUG org.apache.flink.shaded.netty4.io.netty.util.internal.PlatformDependent0 - jdk.internal.misc.Unsafe.allocateUninitializedArray(int): unavailable prior to Java9 2019-10-24 15:13:21,243 DEBUG org.apache.flink.shaded.netty4.io.netty.util.internal.PlatformDependent0 - java.nio.DirectByteBuffer.(long, int): available 2019-10-24 15:13:21,244 DEBUG org.apache.flink.shaded.netty4.io.netty.util.internal.PlatformDependent - sun.misc.Unsafe: available 2019-10-24 15:13:21,244 DEBUG org.apache.flink.shaded.netty4.io.netty.util.internal.PlatformDependent - -Dio.netty.tmpdir: /tmp (java.io.tmpdir) 2019-10-24 15:13:21,244 DEBUG org.apache.flink.shaded.netty4.io.netty.util.internal.PlatformDependent - -Dio.netty.bitMode: 64 (sun.arch.data.model) 2019-10-24 15:13:21,245 DEBUG org.apache.flink.shaded.netty4.io.netty.util.internal.PlatformDependent - -Dio.netty.maxDirectMemory: 696254464 bytes 2019-10-24 15:13:21,245 DEBUG org.apache.flink.shaded.netty4.io.netty.util.internal.PlatformDependent - -Dio.netty.uninitializedArrayAllocationThreshold: -1 2019-10-24 15:13:21,246 DEBUG org.apache.flink.shaded.netty4.io.netty.util.internal.CleanerJava6 - java.nio.ByteBuffer.cleaner(): available 2019-10-24 15:13:21,246 DEBUG org.apache.flink.shaded.netty4.io.netty.util.internal.PlatformDependent - -Dio.netty.noPreferDirect: false 2019-10-24 15:13:21,246 DEBUG org.apache.flink.shaded.netty4.io.netty.buffer.PooledByteBufAllocator - -Dio.netty.allocator.numHeapArenas: 3 2019-10-24 15:13:21,246 DEBUG org.apache.flink.shaded.netty4.io.netty.buffer.PooledByteBufAllocator - -Dio.netty.allocator.numDirectArenas: 4 2019-10-24 15:13:21,246 DEBUG org.apache.flink.shaded.netty4.io.netty.buffer.PooledByteBufAllocator - -Dio.netty.allocator.pageSize: 8192 2019-10-24 15:13:21,246 DEBUG org.apache.flink.shaded.netty4.io.netty.buffer.PooledByteBufAllocator - -Dio.netty.allocator.maxOrder: 11 2019-10-24 15:13:21,249 DEBUG org.apache.flink.shaded.netty4.io.netty.buffer.PooledByteBufAllocator - -Dio.netty.allocator.chunkSize: 16777216 2019-10-24 15:13:21,249 DEBUG org.apache.flink.shaded.netty4.io.netty.buffer.PooledByteBufAllocator - -Dio.netty.allocator.tinyCacheSize: 512 2019-10-24 15:13:21,250 DEBUG org.apache.flink.shaded.netty4.io.netty.buffer.PooledByteBufAllocator - -Dio.netty.allocator.smallCacheSize: 256 2019-10-24 15:13:21,250 DEBUG org.apache.flink.shaded.netty4.io.netty.buffer.PooledByteBufAllocator - -Dio.netty.allocator.normalCacheSize: 64 2019-10-24 15:13:21,250 DEBUG org.apache.flink.shaded.netty4.io.netty.buffer.PooledByteBufAllocator - -Dio.netty.allocator.maxCachedBufferCapacity: 32768 2019-10-24 15:13:21,251 DEBUG org.apache.flink.shaded.netty4.io.netty.buffer.PooledByteBufAllocator - -Dio.netty.allocator.cacheTrimInterval: 8192 2019-10-24 15:13:21,251 DEBUG org.apache.flink.shaded.netty4.io.netty.buffer.PooledByteBufAllocator - -Dio.netty.allocator.useCacheForAllThreads: true 2019-10-24 15:13:21,257 DEBUG org.apache.flink.shaded.netty4.io.netty.util.internal.InternalThreadLocalMap - -Dio.netty.threadLocalMap.stringBuilder.initialSize: 1024 2019-10-24 15:13:21,257 DEBUG org.apache.flink.shaded.netty4.io.netty.util.internal.InternalThreadLocalMap - -Dio.netty.threadLocalMap.stringBuilder.maxSize: 4096 2019-10-24 15:13:21,319 INFO org.apache.flink.runtime.io.network.buffer.NetworkBufferPool - Allocated 64 MB for network buffer pool (number of memory segments: 2048, bytes per segment: 32768). 2019-10-24 15:13:21,335 INFO org.apache.flink.runtime.io.network.NettyShuffleEnvironment - Starting the network environment and its components. 2019-10-24 15:13:21,335 DEBUG org.apache.flink.runtime.io.network.NettyShuffleEnvironment - Starting network connection manager 2019-10-24 15:13:21,345 DEBUG org.apache.flink.shaded.netty4.io.netty.channel.MultithreadEventLoopGroup - -Dio.netty.eventLoopThreads: 4 2019-10-24 15:13:21,364 DEBUG org.apache.flink.shaded.netty4.io.netty.channel.nio.NioEventLoop - -Dio.netty.noKeySetOptimization: false 2019-10-24 15:13:21,365 DEBUG org.apache.flink.shaded.netty4.io.netty.channel.nio.NioEventLoop - -Dio.netty.selectorAutoRebuildThreshold: 512 2019-10-24 15:13:21,373 DEBUG org.apache.flink.shaded.netty4.io.netty.util.internal.PlatformDependent - org.jctools-core.MpscChunkedArrayQueue: available 2019-10-24 15:13:21,386 INFO org.apache.flink.runtime.io.network.netty.NettyClient - Successful initialization (took 49 ms). 2019-10-24 15:13:21,405 DEBUG org.apache.flink.shaded.netty4.io.netty.channel.DefaultChannelId - -Dio.netty.processId: 8 (auto-detected) 2019-10-24 15:13:21,407 DEBUG org.apache.flink.shaded.netty4.io.netty.util.NetUtil - -Djava.net.preferIPv4Stack: false 2019-10-24 15:13:21,408 DEBUG org.apache.flink.shaded.netty4.io.netty.util.NetUtil - -Djava.net.preferIPv6Addresses: false 2019-10-24 15:13:21,410 DEBUG org.apache.flink.shaded.netty4.io.netty.util.NetUtil - Loopback interface: [lo, lo, 127.0.0.1] ({}, {}) 2019-10-24 15:13:21,413 DEBUG org.apache.flink.shaded.netty4.io.netty.util.NetUtil - /proc/sys/net/core/somaxconn: 128 2019-10-24 15:13:21,416 DEBUG org.apache.flink.shaded.netty4.io.netty.channel.DefaultChannelId - -Dio.netty.machineId: 02:42:cd:ff:fe:ca:f5:85 (auto-detected) 2019-10-24 15:13:21,440 DEBUG org.apache.flink.shaded.netty4.io.netty.buffer.ByteBufUtil - -Dio.netty.allocator.type: pooled 2019-10-24 15:13:21,440 DEBUG org.apache.flink.shaded.netty4.io.netty.buffer.ByteBufUtil - -Dio.netty.threadLocalDirectBufferSize: 0 2019-10-24 15:13:21,440 DEBUG org.apache.flink.shaded.netty4.io.netty.buffer.ByteBufUtil - -Dio.netty.maxThreadLocalCharBufferSize: 16384 2019-10-24 15:13:21,452 INFO org.apache.flink.runtime.io.network.netty.NettyServer - Successful initialization (took 64 ms). Listening on SocketAddress /192.168.10.14:31000. 2019-10-24 15:13:21,453 INFO org.apache.flink.runtime.taskexecutor.KvStateService - Starting the kvState service and its components. 2019-10-24 15:13:21,453 WARN org.apache.flink.runtime.taskmanager.TaskManagerLocation - No hostname could be resolved for the IP address 192.168.10.14, using IP address as host name. Local input split assignment (such as for HDFS files) may be impacted. 2019-10-24 15:13:21,453 INFO org.apache.flink.runtime.taskexecutor.TaskManagerServices - Limiting managed memory to 0.7 of the currently free heap space (229 MB), memory will be allocated lazily. 2019-10-24 15:13:21,455 DEBUG org.apache.flink.runtime.memory.MemoryManager - Initialized MemoryManager with total memory size 240547152, number of slots 1, page size 32768, memory type HEAP, pre allocate memory false and number of non allocated pages 7340. 2019-10-24 15:13:21,467 INFO org.apache.flink.runtime.taskexecutor.TaskManagerConfiguration - Messages have a max timeout of 10000 ms 2019-10-24 15:13:21,486 INFO org.apache.flink.runtime.rpc.akka.AkkaRpcService - Starting RPC endpoint for org.apache.flink.runtime.taskexecutor.TaskExecutor at akka://flink/user/taskmanager_0 . 2019-10-24 15:13:21,503 INFO org.apache.flink.runtime.taskexecutor.JobLeaderService - Start job leader service. 2019-10-24 15:13:21,504 INFO org.apache.flink.runtime.filecache.FileCache - User file cache uses directory /tmp/flink-dist-cache-4540e582-d94b-49da-a31c-c9939ffd2907 2019-10-24 15:13:21,505 INFO org.apache.flink.runtime.taskexecutor.TaskExecutor - Connecting to ResourceManager akka.tcp://flink@192.168.10.11:6123/user/resourcemanager(00000000000000000000000000000000). 2019-10-24 15:13:21,509 DEBUG org.apache.flink.runtime.rpc.akka.AkkaRpcService - Try to connect to remote RPC endpoint with address akka.tcp://flink@192.168.10.11:6123/user/resourcemanager. Returning a org.apache.flink.runtime.resourcemanager.ResourceManagerGateway gateway. 2019-10-24 15:13:21,768 INFO org.apache.flink.runtime.taskexecutor.TaskExecutor - Resolved ResourceManager address, beginning registration 2019-10-24 15:13:21,768 INFO org.apache.flink.runtime.taskexecutor.TaskExecutor - Registration at ResourceManager attempt 1 (timeout=100ms) 2019-10-24 15:13:21,846 INFO org.apache.flink.runtime.taskexecutor.TaskExecutor - Successful registration at resource manager akka.tcp://flink@192.168.10.11:6123/user/resourcemanager under registration id 11071ffc1a64f6b4bc6dff275e045de6. 2019-10-24 15:13:21,870 INFO org.apache.flink.runtime.taskexecutor.TaskExecutor - Receive slot request 9e56535cdfbb45513e71b52634167e98 for job f99a5842a78f3fcf6d7e402199c5f01e from resource manager with leader id 00000000000000000000000000000000. 2019-10-24 15:13:21,872 INFO org.apache.flink.runtime.taskexecutor.TaskExecutor - Allocated slot for 9e56535cdfbb45513e71b52634167e98. 2019-10-24 15:13:21,873 INFO org.apache.flink.runtime.taskexecutor.JobLeaderService - Add job f99a5842a78f3fcf6d7e402199c5f01e for job leader monitoring. 2019-10-24 15:13:21,873 DEBUG org.apache.flink.runtime.taskexecutor.JobLeaderService - New leader information for job f99a5842a78f3fcf6d7e402199c5f01e. Address: akka.tcp://flink@192.168.10.11:6123/user/jobmanager_0, leader id: 00000000000000000000000000000000. 2019-10-24 15:13:21,874 INFO org.apache.flink.runtime.taskexecutor.JobLeaderService - Try to register at job manager akka.tcp://flink@192.168.10.11:6123/user/jobmanager_0 with leader id 00000000-0000-0000-0000-000000000000. 2019-10-24 15:13:21,874 DEBUG org.apache.flink.runtime.rpc.akka.AkkaRpcService - Try to connect to remote RPC endpoint with address akka.tcp://flink@192.168.10.11:6123/user/jobmanager_0. Returning a org.apache.flink.runtime.jobmaster.JobMasterGateway gateway. 2019-10-24 15:13:21,907 INFO org.apache.flink.runtime.taskexecutor.JobLeaderService - Resolved JobManager address, beginning registration 2019-10-24 15:13:21,907 INFO org.apache.flink.runtime.taskexecutor.JobLeaderService - Registration at JobManager attempt 1 (timeout=100ms) 2019-10-24 15:13:21,936 INFO org.apache.flink.runtime.taskexecutor.JobLeaderService - Successful registration at job manager akka.tcp://flink@192.168.10.11:6123/user/jobmanager_0 for job f99a5842a78f3fcf6d7e402199c5f01e. 2019-10-24 15:13:21,937 INFO org.apache.flink.runtime.taskexecutor.TaskExecutor - Establish JobManager connection for job f99a5842a78f3fcf6d7e402199c5f01e. 2019-10-24 15:13:21,940 INFO org.apache.flink.runtime.taskexecutor.TaskExecutor - Offer reserved slots to the leader of job f99a5842a78f3fcf6d7e402199c5f01e. 2019-10-24 15:13:21,964 INFO org.apache.flink.runtime.taskexecutor.slot.TaskSlotTable - Activate slot 9e56535cdfbb45513e71b52634167e98. 2019-10-24 15:13:22,011 DEBUG org.apache.flink.runtime.state.TaskExecutorLocalStateStoresManager - Registered new allocation id 9e56535cdfbb45513e71b52634167e98 for local state stores for job f99a5842a78f3fcf6d7e402199c5f01e. 2019-10-24 15:13:22,012 DEBUG org.apache.flink.runtime.state.TaskExecutorLocalStateStoresManager - Registered new local state store with configuration LocalRecoveryConfig{localRecoveryMode=false, localStateDirectories=LocalRecoveryDirectoryProvider{rootDirectories=[/tmp/localState/aid_9e56535cdfbb45513e71b52634167e98], jobID=f99a5842a78f3fcf6d7e402199c5f01e, jobVertexID=018b0b10194113282e1c905a712bd512, subtaskIndex=0}} for f99a5842a78f3fcf6d7e402199c5f01e - 018b0b10194113282e1c905a712bd512 - 0 under allocation id 9e56535cdfbb45513e71b52634167e98. 2019-10-24 15:13:22,020 DEBUG org.apache.flink.runtime.io.network.partition.ResultPartitionFactory - DataSource (at $line27.$read$$iw$$iw$$iw$$iw$$iw$$iw.(:24) (org.apache.flink.api.java.io.CollectionInputFormat)) (1/1) (760b4acb609f82d49b42190638747f59): Initialized org.apache.flink.runtime.io.network.partition.ResultPartitionFactory@6b3020a 2019-10-24 15:13:22,026 INFO org.apache.flink.runtime.taskexecutor.TaskExecutor - Received task DataSource (at $line27.$read$$iw$$iw$$iw$$iw$$iw$$iw.(:24) (org.apache.flink.api.java.io.CollectionInputFormat)) (1/1). 2019-10-24 15:13:22,027 INFO org.apache.flink.runtime.taskmanager.Task - DataSource (at $line27.$read$$iw$$iw$$iw$$iw$$iw$$iw.(:24) (org.apache.flink.api.java.io.CollectionInputFormat)) (1/1) (760b4acb609f82d49b42190638747f59) switched from CREATED to DEPLOYING. 2019-10-24 15:13:22,027 INFO org.apache.flink.runtime.taskmanager.Task - Creating FileSystem stream leak safety net for task DataSource (at $line27.$read$$iw$$iw$$iw$$iw$$iw$$iw.(:24) (org.apache.flink.api.java.io.CollectionInputFormat)) (1/1) (760b4acb609f82d49b42190638747f59) [DEPLOYING] 2019-10-24 15:13:22,032 INFO org.apache.flink.runtime.taskmanager.Task - Loading JAR files for task DataSource (at $line27.$read$$iw$$iw$$iw$$iw$$iw$$iw.(:24) (org.apache.flink.api.java.io.CollectionInputFormat)) (1/1) (760b4acb609f82d49b42190638747f59) [DEPLOYING]. 2019-10-24 15:13:22,038 INFO org.apache.flink.runtime.blob.BlobClient - Downloading f99a5842a78f3fcf6d7e402199c5f01e/p-887e272e36aaa83654095451ee17cae86448085c-c82de29eac2065cbf484b9ed02aa3705 from /192.168.10.11:34871 2019-10-24 15:13:22,044 DEBUG org.apache.flink.runtime.blob.BlobClient - GET BLOB f99a5842a78f3fcf6d7e402199c5f01e/p-887e272e36aaa83654095451ee17cae86448085c-c82de29eac2065cbf484b9ed02aa3705 from /192.168.10.14:37906. 2019-10-24 15:13:22,056 DEBUG org.apache.flink.runtime.taskmanager.Task - Getting user code class loader for task 760b4acb609f82d49b42190638747f59 at library cache manager took 24 milliseconds 2019-10-24 15:13:22,074 INFO org.apache.flink.runtime.taskmanager.Task - Registering task at network: DataSource (at $line27.$read$$iw$$iw$$iw$$iw$$iw$$iw.(:24) (org.apache.flink.api.java.io.CollectionInputFormat)) (1/1) (760b4acb609f82d49b42190638747f59) [DEPLOYING]. 2019-10-24 15:13:22,075 DEBUG org.apache.flink.runtime.io.network.buffer.LocalBufferPool - Using a local buffer pool with 1-2147483647 buffers 2019-10-24 15:13:22,076 DEBUG org.apache.flink.runtime.io.network.partition.ResultPartitionManager - Registered ReleaseOnConsumptionResultPartition 7c0c21013e6fcba2458bec2027fd6f28@760b4acb609f82d49b42190638747f59 [PIPELINED, 1 subpartitions, 1 pending consumptions]. 2019-10-24 15:13:22,076 DEBUG org.apache.flink.runtime.io.network.TaskEventDispatcher - registering 7c0c21013e6fcba2458bec2027fd6f28@760b4acb609f82d49b42190638747f59 2019-10-24 15:13:22,087 INFO org.apache.flink.runtime.taskmanager.Task - DataSource (at $line27.$read$$iw$$iw$$iw$$iw$$iw$$iw.(:24) (org.apache.flink.api.java.io.CollectionInputFormat)) (1/1) (760b4acb609f82d49b42190638747f59) switched from DEPLOYING to RUNNING. 2019-10-24 15:13:22,142 DEBUG org.apache.flink.runtime.operators.DataSourceTask - Start registering input and output: DataSource (at $line27.$read$$iw$$iw$$iw$$iw$$iw$$iw.(:24) (org.apache.flink.api.java.io.CollectionInputFormat)) (1/1) 2019-10-24 15:13:22,159 DEBUG org.apache.flink.runtime.operators.DataSourceTask - Finished registering input and output: DataSource (at $line27.$read$$iw$$iw$$iw$$iw$$iw$$iw.(:24) (org.apache.flink.api.java.io.CollectionInputFormat)) (1/1) 2019-10-24 15:13:22,160 DEBUG org.apache.flink.runtime.operators.DataSourceTask - Starting data source operator: DataSource (at $line27.$read$$iw$$iw$$iw$$iw$$iw$$iw.(:24) (org.apache.flink.api.java.io.CollectionInputFormat)) (1/1) 2019-10-24 15:13:22,161 WARN org.apache.flink.metrics.MetricGroup - The operator name DataSource (at $line27.$read$$iw$$iw$$iw$$iw$$iw$$iw.(:24) (org.apache.flink.api.java.io.CollectionInputFormat)) exceeded the 80 characters length limit and was truncated. 2019-10-24 15:13:22,168 DEBUG org.apache.flink.runtime.operators.DataSourceTask - Rich Source detected. Initializing runtime context.: DataSource (at $line27.$read$$iw$$iw$$iw$$iw$$iw$$iw.(:24) (org.apache.flink.api.java.io.CollectionInputFormat)) (1/1) 2019-10-24 15:13:22,169 DEBUG org.apache.flink.runtime.operators.DataSourceTask - Rich Source detected. Opening the InputFormat.: DataSource (at $line27.$read$$iw$$iw$$iw$$iw$$iw$$iw.(:24) (org.apache.flink.api.java.io.CollectionInputFormat)) (1/1) 2019-10-24 15:13:22,170 DEBUG org.apache.flink.runtime.operators.DataSourceTask - DataSourceTask object reuse: DISABLED. 2019-10-24 15:13:22,212 DEBUG org.apache.flink.runtime.operators.DataSourceTask - Opening input split GenericSplit (0/1): DataSource (at $line27.$read$$iw$$iw$$iw$$iw$$iw$$iw.(:24) (org.apache.flink.api.java.io.CollectionInputFormat)) (1/1) 2019-10-24 15:13:22,213 DEBUG org.apache.flink.runtime.operators.DataSourceTask - Starting to read input from split GenericSplit (0/1): DataSource (at $line27.$read$$iw$$iw$$iw$$iw$$iw$$iw.(:24) (org.apache.flink.api.java.io.CollectionInputFormat)) (1/1) 2019-10-24 15:13:22,234 DEBUG org.apache.flink.shaded.netty4.io.netty.buffer.AbstractByteBuf - -Dorg.apache.flink.shaded.netty4.io.netty.buffer.checkAccessible: true 2019-10-24 15:13:22,234 DEBUG org.apache.flink.shaded.netty4.io.netty.buffer.AbstractByteBuf - -Dorg.apache.flink.shaded.netty4.io.netty.buffer.checkBounds: true 2019-10-24 15:13:22,240 DEBUG org.apache.flink.shaded.netty4.io.netty.util.ResourceLeakDetectorFactory - Loaded default ResourceLeakDetector: org.apache.flink.shaded.netty4.io.netty.util.ResourceLeakDetector@1e19fc10 2019-10-24 15:13:22,264 DEBUG org.apache.flink.runtime.operators.DataSourceTask - Closing input split GenericSplit (0/1): DataSource (at $line27.$read$$iw$$iw$$iw$$iw$$iw$$iw.(:24) (org.apache.flink.api.java.io.CollectionInputFormat)) (1/1) 2019-10-24 15:13:22,372 DEBUG org.apache.flink.runtime.state.TaskExecutorLocalStateStoresManager - Registered new local state store with configuration LocalRecoveryConfig{localRecoveryMode=false, localStateDirectories=LocalRecoveryDirectoryProvider{rootDirectories=[/tmp/localState/aid_9e56535cdfbb45513e71b52634167e98], jobID=f99a5842a78f3fcf6d7e402199c5f01e, jobVertexID=8ac2632a1cf2e75745ad08a673e3e409, subtaskIndex=0}} for f99a5842a78f3fcf6d7e402199c5f01e - 8ac2632a1cf2e75745ad08a673e3e409 - 0 under allocation id 9e56535cdfbb45513e71b52634167e98. 2019-10-24 15:13:22,383 DEBUG org.apache.flink.runtime.operators.DataSourceTask - Rich Source detected. Closing the InputFormat.: DataSource (at $line27.$read$$iw$$iw$$iw$$iw$$iw$$iw.(:24) (org.apache.flink.api.java.io.CollectionInputFormat)) (1/1) 2019-10-24 15:13:22,383 DEBUG org.apache.flink.runtime.operators.DataSourceTask - Finished data source operator: DataSource (at $line27.$read$$iw$$iw$$iw$$iw$$iw$$iw.(:24) (org.apache.flink.api.java.io.CollectionInputFormat)) (1/1) 2019-10-24 15:13:22,392 DEBUG org.apache.flink.runtime.io.network.partition.consumer.SingleInputGateFactory - DataSink (org.apache.flink.api.java.Utils$CollectHelper@24bb21ed) (1/1) (25571644bc439163a6644e3a6ab4f6c3): Created 1 input channels (local: 1, remote: 0, unknown: 0). 2019-10-24 15:13:22,402 DEBUG org.apache.flink.runtime.io.network.partition.PipelinedSubpartition - DataSource (at $line27.$read$$iw$$iw$$iw$$iw$$iw$$iw.(:24) (org.apache.flink.api.java.io.CollectionInputFormat)) (1/1) (760b4acb609f82d49b42190638747f59): Finished PipelinedSubpartition#0 [number of buffers: 2 (0 bytes), number of buffers in backlog: 1, finished? true, read view? false]. 2019-10-24 15:13:22,402 INFO org.apache.flink.runtime.taskmanager.Task - DataSource (at $line27.$read$$iw$$iw$$iw$$iw$$iw$$iw.(:24) (org.apache.flink.api.java.io.CollectionInputFormat)) (1/1) (760b4acb609f82d49b42190638747f59) switched from RUNNING to FINISHED. 2019-10-24 15:13:22,402 INFO org.apache.flink.runtime.taskmanager.Task - Freeing task resources for DataSource (at $line27.$read$$iw$$iw$$iw$$iw$$iw$$iw.(:24) (org.apache.flink.api.java.io.CollectionInputFormat)) (1/1) (760b4acb609f82d49b42190638747f59). 2019-10-24 15:13:22,402 DEBUG org.apache.flink.runtime.taskmanager.Task - Release task DataSource (at $line27.$read$$iw$$iw$$iw$$iw$$iw$$iw.(:24) (org.apache.flink.api.java.io.CollectionInputFormat)) (1/1) network resources (state: FINISHED). 2019-10-24 15:13:22,402 DEBUG org.apache.flink.runtime.io.network.TaskEventDispatcher - unregistering 7c0c21013e6fcba2458bec2027fd6f28@760b4acb609f82d49b42190638747f59 2019-10-24 15:13:22,402 INFO org.apache.flink.runtime.taskmanager.Task - Ensuring all FileSystem streams are closed for task DataSource (at $line27.$read$$iw$$iw$$iw$$iw$$iw$$iw.(:24) (org.apache.flink.api.java.io.CollectionInputFormat)) (1/1) (760b4acb609f82d49b42190638747f59) [FINISHED] 2019-10-24 15:13:22,412 INFO org.apache.flink.runtime.taskexecutor.TaskExecutor - Received task DataSink (org.apache.flink.api.java.Utils$CollectHelper@24bb21ed) (1/1). 2019-10-24 15:13:22,416 INFO org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and sending final execution state FINISHED to JobManager for task DataSource (at $line27.$read$$iw$$iw$$iw$$iw$$iw$$iw.(:24) (org.apache.flink.api.java.io.CollectionInputFormat)) 760b4acb609f82d49b42190638747f59. 2019-10-24 15:13:22,435 INFO org.apache.flink.runtime.taskmanager.Task - DataSink (org.apache.flink.api.java.Utils$CollectHelper@24bb21ed) (1/1) (25571644bc439163a6644e3a6ab4f6c3) switched from CREATED to DEPLOYING. 2019-10-24 15:13:22,437 INFO org.apache.flink.runtime.taskmanager.Task - Creating FileSystem stream leak safety net for task DataSink (org.apache.flink.api.java.Utils$CollectHelper@24bb21ed) (1/1) (25571644bc439163a6644e3a6ab4f6c3) [DEPLOYING] 2019-10-24 15:13:22,452 INFO org.apache.flink.runtime.taskmanager.Task - Loading JAR files for task DataSink (org.apache.flink.api.java.Utils$CollectHelper@24bb21ed) (1/1) (25571644bc439163a6644e3a6ab4f6c3) [DEPLOYING]. 2019-10-24 15:13:22,453 DEBUG org.apache.flink.runtime.taskmanager.Task - Getting user code class loader for task 25571644bc439163a6644e3a6ab4f6c3 at library cache manager took 1 milliseconds 2019-10-24 15:13:22,455 INFO org.apache.flink.runtime.taskmanager.Task - Registering task at network: DataSink (org.apache.flink.api.java.Utils$CollectHelper@24bb21ed) (1/1) (25571644bc439163a6644e3a6ab4f6c3) [DEPLOYING]. 2019-10-24 15:13:22,455 DEBUG org.apache.flink.runtime.io.network.buffer.LocalBufferPool - Using a local buffer pool with 0-2147483647 buffers 2019-10-24 15:13:22,455 DEBUG org.apache.flink.runtime.io.network.partition.consumer.LocalInputChannel - LocalInputChannel [7c0c21013e6fcba2458bec2027fd6f28@760b4acb609f82d49b42190638747f59]: Requesting LOCAL subpartition 0 of partition 7c0c21013e6fcba2458bec2027fd6f28@760b4acb609f82d49b42190638747f59. 2019-10-24 15:13:22,455 DEBUG org.apache.flink.runtime.io.network.partition.ResultPartitionManager - Requesting subpartition 0 of ReleaseOnConsumptionResultPartition 7c0c21013e6fcba2458bec2027fd6f28@760b4acb609f82d49b42190638747f59 [PIPELINED, 1 subpartitions, 1 pending consumptions]. 2019-10-24 15:13:22,456 DEBUG org.apache.flink.runtime.io.network.partition.PipelinedSubpartition - DataSource (at $line27.$read$$iw$$iw$$iw$$iw$$iw$$iw.(:24) (org.apache.flink.api.java.io.CollectionInputFormat)) (1/1) (760b4acb609f82d49b42190638747f59): Creating read view for subpartition 0 of partition 7c0c21013e6fcba2458bec2027fd6f28@760b4acb609f82d49b42190638747f59. 2019-10-24 15:13:22,456 DEBUG org.apache.flink.runtime.io.network.partition.ResultPartition - Created PipelinedSubpartitionView(index: 0) of ResultPartition 7c0c21013e6fcba2458bec2027fd6f28@760b4acb609f82d49b42190638747f59 2019-10-24 15:13:22,458 INFO org.apache.flink.runtime.taskmanager.Task - DataSink (org.apache.flink.api.java.Utils$CollectHelper@24bb21ed) (1/1) (25571644bc439163a6644e3a6ab4f6c3) switched from DEPLOYING to RUNNING. 2019-10-24 15:13:22,460 DEBUG org.apache.flink.runtime.operators.DataSinkTask - Start registering input and output: DataSink (org.apache.flink.api.java.Utils$CollectHelper@24bb21ed) (1/1) 2019-10-24 15:13:22,470 DEBUG org.apache.flink.runtime.operators.DataSinkTask - Finished registering input and output: DataSink (org.apache.flink.api.java.Utils$CollectHelper@24bb21ed) (1/1) 2019-10-24 15:13:22,470 DEBUG org.apache.flink.runtime.operators.DataSinkTask - Starting data sink operator: DataSink (org.apache.flink.api.java.Utils$CollectHelper@24bb21ed) (1/1) 2019-10-24 15:13:22,470 DEBUG org.apache.flink.runtime.operators.DataSinkTask - Rich Sink detected. Initializing runtime context.: DataSink (org.apache.flink.api.java.Utils$CollectHelper@24bb21ed) (1/1) 2019-10-24 15:13:22,471 DEBUG org.apache.flink.runtime.operators.DataSinkTask - Starting to produce output: DataSink (org.apache.flink.api.java.Utils$CollectHelper@24bb21ed) (1/1) 2019-10-24 15:13:22,482 DEBUG org.apache.flink.runtime.io.network.partition.ResultPartition - ReleaseOnConsumptionResultPartition 7c0c21013e6fcba2458bec2027fd6f28@760b4acb609f82d49b42190638747f59 [PIPELINED, 1 subpartitions, 0 pending consumptions]: Received consumed notification for subpartition 0. 2019-10-24 15:13:22,482 DEBUG org.apache.flink.runtime.io.network.partition.ResultPartitionManager - Received consume notification from ReleaseOnConsumptionResultPartition 7c0c21013e6fcba2458bec2027fd6f28@760b4acb609f82d49b42190638747f59 [PIPELINED, 1 subpartitions, 0 pending consumptions]. 2019-10-24 15:13:22,482 DEBUG org.apache.flink.runtime.io.network.partition.ResultPartition - DataSource (at $line27.$read$$iw$$iw$$iw$$iw$$iw$$iw.(:24) (org.apache.flink.api.java.io.CollectionInputFormat)) (1/1) (760b4acb609f82d49b42190638747f59): Releasing ReleaseOnConsumptionResultPartition 7c0c21013e6fcba2458bec2027fd6f28@760b4acb609f82d49b42190638747f59 [PIPELINED, 1 subpartitions, 0 pending consumptions]. 2019-10-24 15:13:22,482 DEBUG org.apache.flink.runtime.io.network.partition.PipelinedSubpartition - DataSource (at $line27.$read$$iw$$iw$$iw$$iw$$iw$$iw.(:24) (org.apache.flink.api.java.io.CollectionInputFormat)) (1/1) (760b4acb609f82d49b42190638747f59): Released PipelinedSubpartition#0 [number of buffers: 2 (752 bytes), number of buffers in backlog: 0, finished? true, read view? false]. 2019-10-24 15:13:22,482 DEBUG org.apache.flink.runtime.io.network.partition.ResultPartitionManager - Released partition 7c0c21013e6fcba2458bec2027fd6f28 produced by 760b4acb609f82d49b42190638747f59. 2019-10-24 15:13:22,483 DEBUG org.apache.flink.runtime.operators.DataSinkTask - Finished data sink operator: DataSink (org.apache.flink.api.java.Utils$CollectHelper@24bb21ed) (1/1) 2019-10-24 15:13:22,483 INFO org.apache.flink.runtime.taskmanager.Task - DataSink (org.apache.flink.api.java.Utils$CollectHelper@24bb21ed) (1/1) (25571644bc439163a6644e3a6ab4f6c3) switched from RUNNING to FINISHED. 2019-10-24 15:13:22,483 INFO org.apache.flink.runtime.taskmanager.Task - Freeing task resources for DataSink (org.apache.flink.api.java.Utils$CollectHelper@24bb21ed) (1/1) (25571644bc439163a6644e3a6ab4f6c3). 2019-10-24 15:13:22,483 DEBUG org.apache.flink.runtime.taskmanager.Task - Release task DataSink (org.apache.flink.api.java.Utils$CollectHelper@24bb21ed) (1/1) network resources (state: FINISHED). 2019-10-24 15:13:22,483 DEBUG org.apache.flink.runtime.io.network.partition.consumer.SingleInputGate - DataSink (org.apache.flink.api.java.Utils$CollectHelper@24bb21ed) (1/1) (25571644bc439163a6644e3a6ab4f6c3): Releasing org.apache.flink.runtime.io.network.partition.consumer.SingleInputGate@4dff13f3. 2019-10-24 15:13:22,483 INFO org.apache.flink.runtime.taskmanager.Task - Ensuring all FileSystem streams are closed for task DataSink (org.apache.flink.api.java.Utils$CollectHelper@24bb21ed) (1/1) (25571644bc439163a6644e3a6ab4f6c3) [FINISHED] 2019-10-24 15:13:22,483 INFO org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and sending final execution state FINISHED to JobManager for task DataSink (org.apache.flink.api.java.Utils$CollectHelper@24bb21ed) 25571644bc439163a6644e3a6ab4f6c3. 2019-10-24 15:13:22,756 DEBUG org.apache.flink.runtime.taskexecutor.TaskExecutor - Free slot with allocation id 9e56535cdfbb45513e71b52634167e98 because: Stopping JobMaster for job Flink Java Job at Thu Oct 24 15:13:13 UTC 2019(f99a5842a78f3fcf6d7e402199c5f01e). 2019-10-24 15:13:22,757 DEBUG org.apache.flink.runtime.taskexecutor.slot.TaskSlotTable - Free slot TaskSlot(index:0, state:ACTIVE, resource profile: ResourceProfile{cpuCores=1.7976931348623157E308, heapMemoryInMB=2147483647, directMemoryInMB=2147483647, nativeMemoryInMB=2147483647, networkMemoryInMB=2147483647, managedMemoryInMB=229}, allocationId: 9e56535cdfbb45513e71b52634167e98, jobId: f99a5842a78f3fcf6d7e402199c5f01e). org.apache.flink.util.FlinkException: Stopping JobMaster for job Flink Java Job at Thu Oct 24 15:13:13 UTC 2019(f99a5842a78f3fcf6d7e402199c5f01e). at org.apache.flink.runtime.jobmaster.JobMaster.onStop(JobMaster.java:340) at org.apache.flink.runtime.rpc.RpcEndpoint.internalCallOnStop(RpcEndpoint.java:218) at org.apache.flink.runtime.rpc.akka.AkkaRpcActor$StartedState.terminate(AkkaRpcActor.java:509) at org.apache.flink.runtime.rpc.akka.AkkaRpcActor.handleControlMessage(AkkaRpcActor.java:175) at akka.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:26) at akka.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:21) at scala.PartialFunction$class.applyOrElse(PartialFunction.scala:123) at akka.japi.pf.UnitCaseStatement.applyOrElse(CaseStatements.scala:21) at scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:170) at scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:171) at akka.actor.Actor$class.aroundReceive(Actor.scala:517) at akka.actor.AbstractActor.aroundReceive(AbstractActor.scala:225) at akka.actor.ActorCell.receiveMessage(ActorCell.scala:592) at akka.actor.ActorCell.invoke(ActorCell.scala:561) at akka.dispatch.Mailbox.processMailbox(Mailbox.scala:258) at akka.dispatch.Mailbox.run(Mailbox.scala:225) at akka.dispatch.Mailbox.exec(Mailbox.scala:235) at akka.dispatch.forkjoin.ForkJoinTask.doExec(ForkJoinTask.java:260) at akka.dispatch.forkjoin.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:1339) at akka.dispatch.forkjoin.ForkJoinPool.runWorker(ForkJoinPool.java:1979) at akka.dispatch.forkjoin.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:107) 2019-10-24 15:13:22,760 INFO org.apache.flink.runtime.taskexecutor.JobLeaderService - Remove job f99a5842a78f3fcf6d7e402199c5f01e from job leader monitoring. 2019-10-24 15:13:22,761 DEBUG org.apache.flink.runtime.taskexecutor.TaskExecutor - Close JobManager connection for job f99a5842a78f3fcf6d7e402199c5f01e. org.apache.flink.util.FlinkException: TaskExecutor akka.tcp://flink@192.168.10.14:31001/user/taskmanager_0 has no more allocated slots for job f99a5842a78f3fcf6d7e402199c5f01e. at org.apache.flink.runtime.taskexecutor.TaskExecutor.closeJobManagerConnectionIfNoAllocatedResources(TaskExecutor.java:1523) at org.apache.flink.runtime.taskexecutor.TaskExecutor.freeSlotInternal(TaskExecutor.java:1501) at org.apache.flink.runtime.taskexecutor.TaskExecutor.freeSlot(TaskExecutor.java:897) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.flink.runtime.rpc.akka.AkkaRpcActor.handleRpcInvocation(AkkaRpcActor.java:279) at org.apache.flink.runtime.rpc.akka.AkkaRpcActor.handleRpcMessage(AkkaRpcActor.java:194) at org.apache.flink.runtime.rpc.akka.AkkaRpcActor.handleMessage(AkkaRpcActor.java:152) at akka.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:26) at akka.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:21) at scala.PartialFunction$class.applyOrElse(PartialFunction.scala:123) at akka.japi.pf.UnitCaseStatement.applyOrElse(CaseStatements.scala:21) at scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:170) at scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:171) at scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:171) at akka.actor.Actor$class.aroundReceive(Actor.scala:517) at akka.actor.AbstractActor.aroundReceive(AbstractActor.scala:225) at akka.actor.ActorCell.receiveMessage(ActorCell.scala:592) at akka.actor.ActorCell.invoke(ActorCell.scala:561) at akka.dispatch.Mailbox.processMailbox(Mailbox.scala:258) at akka.dispatch.Mailbox.run(Mailbox.scala:225) at akka.dispatch.Mailbox.exec(Mailbox.scala:235) at akka.dispatch.forkjoin.ForkJoinTask.doExec(ForkJoinTask.java:260) at akka.dispatch.forkjoin.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:1339) at akka.dispatch.forkjoin.ForkJoinPool.runWorker(ForkJoinPool.java:1979) at akka.dispatch.forkjoin.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:107) 2019-10-24 15:13:22,765 DEBUG org.apache.flink.runtime.state.TaskExecutorLocalStateStoresManager - Releasing local state under allocation id 9e56535cdfbb45513e71b52634167e98. 2019-10-24 15:13:22,770 DEBUG org.apache.flink.runtime.taskexecutor.TaskExecutor - Close JobManager connection for job f99a5842a78f3fcf6d7e402199c5f01e. org.apache.flink.util.FlinkException: Stopping JobMaster for job Flink Java Job at Thu Oct 24 15:13:13 UTC 2019(f99a5842a78f3fcf6d7e402199c5f01e). at org.apache.flink.runtime.jobmaster.JobMaster.onStop(JobMaster.java:340) at org.apache.flink.runtime.rpc.RpcEndpoint.internalCallOnStop(RpcEndpoint.java:218) at org.apache.flink.runtime.rpc.akka.AkkaRpcActor$StartedState.terminate(AkkaRpcActor.java:509) at org.apache.flink.runtime.rpc.akka.AkkaRpcActor.handleControlMessage(AkkaRpcActor.java:175) at akka.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:26) at akka.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:21) at scala.PartialFunction$class.applyOrElse(PartialFunction.scala:123) at akka.japi.pf.UnitCaseStatement.applyOrElse(CaseStatements.scala:21) at scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:170) at scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:171) at akka.actor.Actor$class.aroundReceive(Actor.scala:517) at akka.actor.AbstractActor.aroundReceive(AbstractActor.scala:225) at akka.actor.ActorCell.receiveMessage(ActorCell.scala:592) at akka.actor.ActorCell.invoke(ActorCell.scala:561) at akka.dispatch.Mailbox.processMailbox(Mailbox.scala:258) at akka.dispatch.Mailbox.run(Mailbox.scala:225) at akka.dispatch.Mailbox.exec(Mailbox.scala:235) at akka.dispatch.forkjoin.ForkJoinTask.doExec(ForkJoinTask.java:260) at akka.dispatch.forkjoin.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:1339) at akka.dispatch.forkjoin.ForkJoinPool.runWorker(ForkJoinPool.java:1979) at akka.dispatch.forkjoin.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:107) 2019-10-24 15:13:22,771 INFO org.apache.flink.runtime.taskexecutor.JobLeaderService - Cannot reconnect to job f99a5842a78f3fcf6d7e402199c5f01e because it is not registered. 2019-10-24 15:13:28,118 DEBUG org.apache.flink.runtime.taskexecutor.TaskExecutor - Received heartbeat request from d84a3614ecefa51ed52ef3403762652e. 2019-10-24 15:13:38,129 DEBUG org.apache.flink.runtime.taskexecutor.TaskExecutor - Received heartbeat request from d84a3614ecefa51ed52ef3403762652e.