Concurrent map iteration and map write

[joliver]

Nomad version

v0.7.0-rc1

Operating system and Environment details

Ubuntu 16.04 amd64

Issue

It looks like one of the dependencies in Nomad doesn't properly lock around iterating/writing to a map at the same time.

Reproduction steps

This occurred during a time when network connectivity to the machine in question was unavailable.

Nomad Server logs (if appropriate)

fatal error: concurrent map iteration and map write
goroutine 96 [running]:
runtime.throw(0x15bf195, 0x26)
#011/usr/local/go/src/runtime/panic.go:605 +0x95 fp=0xc42087b2f0 sp=0xc42087b2d0 pc=0x42dac5
runtime.mapiternext(0xc42087b3c0)
#011/usr/local/go/src/runtime/hashmap.go:778 +0x6f1 fp=0xc42087b388 sp=0xc42087b2f0 pc=0x40bf31
github.com/hashicorp/nomad/vendor/github.com/hashicorp/go-msgpack/codec.(*Encoder).encMapStrStr(0xc42022a070, 0xc4205cec30)
#011/build/nomad-0.7.0/src/github.com/hashicorp/nomad/vendor/github.com/hashicorp/go-msgpack/codec/encode.go:950 +0x106 fp=0xc42087b430 sp=0xc42087b388 pc=0x7edf36
github.com/hashicorp/nomad/vendor/github.com/hashicorp/go-msgpack/codec.(*encFnInfo).kMap(0xc4207c48d0, 0x1383ea0, 0xc4202bc058, 0x195)
#011/build/nomad-0.7.0/src/github.com/hashicorp/nomad/vendor/github.com/hashicorp/go-msgpack/codec/encode.go:544 +0x4e3 fp=0xc42087b4b0 sp=0xc42087b430 pc=0x7eb9d3
github.com/hashicorp/nomad/vendor/github.com/hashicorp/go-msgpack/codec.(*Encoder).encodeValue(0xc42022a070, 0x1383ea0, 0xc4202bc058, 0x195)
#011/build/nomad-0.7.0/src/github.com/hashicorp/nomad/vendor/github.com/hashicorp/go-msgpack/codec/encode.go:899 +0x1c6 fp=0xc42087b5a8 sp=0xc42087b4b0 pc=0x7ed4a6
github.com/hashicorp/nomad/vendor/github.com/hashicorp/go-msgpack/codec.(*encFnInfo).kStruct(0xc4207c4690, 0x155fb80, 0xc4202bc000, 0x199)
#011/build/nomad-0.7.0/src/github.com/hashicorp/nomad/vendor/github.com/hashicorp/go-msgpack/codec/encode.go:502 +0x672 fp=0xc42087b6b0 sp=0xc42087b5a8 pc=0x7eb252
github.com/hashicorp/nomad/vendor/github.com/hashicorp/go-msgpack/codec.(*Encoder).encodeValue(0xc42022a070, 0x14ac180, 0xc4203b2740, 0x196)
#011/build/nomad-0.7.0/src/github.com/hashicorp/nomad/vendor/github.com/hashicorp/go-msgpack/codec/encode.go:899 +0x1c6 fp=0xc42087b7a8 sp=0xc42087b6b0 pc=0x7ed4a6
github.com/hashicorp/nomad/vendor/github.com/hashicorp/go-msgpack/codec.(*encFnInfo).kStruct(0xc4207c45a0, 0x14854c0, 0xc4203b2740, 0x199)
#011/build/nomad-0.7.0/src/github.com/hashicorp/nomad/vendor/github.com/hashicorp/go-msgpack/codec/encode.go:502 +0x672 fp=0xc42087b8b0 sp=0xc42087b7a8 pc=0x7eb252
github.com/hashicorp/nomad/vendor/github.com/hashicorp/go-msgpack/codec.(*Encoder).encodeValue(0xc42022a070, 0x147bf20, 0xc4203b2740, 0x16)
#011/build/nomad-0.7.0/src/github.com/hashicorp/nomad/vendor/github.com/hashicorp/go-msgpack/codec/encode.go:899 +0x1c6 fp=0xc42087b9a8 sp=0xc42087b8b0 pc=0x7ed4a6
github.com/hashicorp/nomad/vendor/github.com/hashicorp/go-msgpack/codec.(*Encoder).encode(0xc42022a070, 0x147bf20, 0xc4203b2740)
#011/build/nomad-0.7.0/src/github.com/hashicorp/nomad/vendor/github.com/hashicorp/go-msgpack/codec/encode.go:814 +0x10a fp=0xc42087b9e0 sp=0xc42087b9a8 pc=0x7ec15a
github.com/hashicorp/nomad/vendor/github.com/hashicorp/go-msgpack/codec.(*Encoder).Encode(0xc42022a070, 0x147bf20, 0xc4203b2740, 0x0, 0x0)
#011/build/nomad-0.7.0/src/github.com/hashicorp/nomad/vendor/github.com/hashicorp/go-msgpack/codec/encode.go:698 +0x7b fp=0xc42087ba08 sp=0xc42087b9e0 pc=0x7ec00b
github.com/hashicorp/nomad/vendor/github.com/hashicorp/net-rpc-msgpackrpc.(*MsgpackCodec).write(0xc4203b27c0, 0x12cde40, 0xc42053a600, 0x147bf20, 0xc4203b2740, 0x14369a0, 0xc420344801)
#011/build/nomad-0.7.0/src/github.com/hashicorp/nomad/vendor/github.com/hashicorp/net-rpc-msgpackrpc/codec.go:102 +0x8b fp=0xc42087ba40 sp=0xc42087ba08 pc=0xe83e3b
github.com/hashicorp/nomad/vendor/github.com/hashicorp/net-rpc-msgpackrpc.(*MsgpackCodec).WriteRequest(0xc4203b27c0, 0xc42053a600, 0x147bf20, 0xc4203b2740, 0x0, 0x0)
#011/build/nomad-0.7.0/src/github.com/hashicorp/nomad/vendor/github.com/hashicorp/net-rpc-msgpackrpc/codec.go:84 +0xaa fp=0xc42087ba90 sp=0xc42087ba40 pc=0xe83cea
github.com/hashicorp/nomad/vendor/github.com/hashicorp/net-rpc-msgpackrpc.CallWithCodec(0x1fcba00, 0xc4203b27c0, 0x15995b9, 0xd, 0x147bf20, 0xc4203b2740, 0x13e78c0, 0xc420013880, 0x0, 0x0)
#011/build/nomad-0.7.0/src/github.com/hashicorp/nomad/vendor/github.com/hashicorp/net-rpc-msgpackrpc/client.go:25 +0xc6 fp=0xc42087bb20 sp=0xc42087ba90 pc=0xe82ff6
github.com/hashicorp/nomad/nomad.(*ConnPool).RPC(0xc42039a000, 0x1590375, 0x6, 0x1fc3800, 0xc420acf8f0, 0x1, 0x15995b9, 0xd, 0x147bf20, 0xc4203b2740, ...)
#011/build/nomad-0.7.0/src/github.com/hashicorp/nomad/nomad/pool.go:363 +0x1a8 fp=0xc42087bbc0 sp=0xc42087bb20 pc=0xee09f8
github.com/hashicorp/nomad/client.(*Client).RPC(0xc42025a160, 0x15995b9, 0xd, 0x147bf20, 0xc4203b2740, 0x13e78c0, 0xc420013880, 0xc42087deb0, 0x3)
#011/build/nomad-0.7.0/src/github.com/hashicorp/nomad/client/client.go:457 +0x219 fp=0xc42087bcc0 sp=0xc42087bbc0 pc=0x10523f9
github.com/hashicorp/nomad/client.(*Client).registerNode(0xc42025a160, 0x0, 0x0)
#011/build/nomad-0.7.0/src/github.com/hashicorp/nomad/client/client.go:1155 +0x179 fp=0xc42087bd90 sp=0xc42087bcc0 pc=0x1058a19
github.com/hashicorp/nomad/client.(*Client).retryRegisterNode(0xc42025a160)
#011/build/nomad-0.7.0/src/github.com/hashicorp/nomad/client/client.go:1126 +0x43 fp=0xc42087bed0 sp=0xc42087bd90 pc=0x10585e3
github.com/hashicorp/nomad/client.(*Client).watchNodeUpdates(0xc42025a160)
#011/build/nomad-0.7.0/src/github.com/hashicorp/nomad/client/client.go:1510 +0x2de fp=0xc42087bfd8 sp=0xc42087bed0 pc=0x105b7fe
runtime.goexit()

[dadgar]

Do you have the full stack trace? If so would you mind adding it to this issue

[SunSparc]

Ok, just remember, you asked for it. 😄 Here are the 1200+ lines of stack trace from the syslog:

Oct 27 04:56:07 nomad[6207]: fatal error: concurrent map iteration and map write
Oct 27 04:56:08 nomad[6207]: goroutine 96 [running]:
Oct 27 04:56:08 nomad[6207]: runtime.throw(0x15bf195, 0x26)
Oct 27 04:56:08 nomad[6207]: #011/usr/local/go/src/runtime/panic.go:605 +0x95 fp=0xc42087b2f0 sp=0xc42087b2d0 pc=0x42dac5
Oct 27 04:56:08 nomad[6207]: runtime.mapiternext(0xc42087b3c0)
Oct 27 04:56:08 nomad[6207]: #011/usr/local/go/src/runtime/hashmap.go:778 +0x6f1 fp=0xc42087b388 sp=0xc42087b2f0 pc=0x40bf31
Oct 27 04:56:08 nomad[6207]: github.com/hashicorp/nomad/vendor/github.com/hashicorp/go-msgpack/codec.(*Encoder).encMapStrStr(0xc42022a070, 0xc4205cec30)
Oct 27 04:56:08 nomad[6207]: #011/build/nomad-0.7.0/src/github.com/hashicorp/nomad/vendor/github.com/hashicorp/go-msgpack/codec/encode.go:950 +0x106 fp=0xc42087b430 sp=0xc42087b388 pc=0x7edf36
Oct 27 04:56:08 nomad[6207]: github.com/hashicorp/nomad/vendor/github.com/hashicorp/go-msgpack/codec.(*encFnInfo).kMap(0xc4207c48d0, 0x1383ea0, 0xc4202bc058, 0x195)
Oct 27 04:56:08 nomad[6207]: #011/build/nomad-0.7.0/src/github.com/hashicorp/nomad/vendor/github.com/hashicorp/go-msgpack/codec/encode.go:544 +0x4e3 fp=0xc42087b4b0 sp=0xc42087b430 pc=0x7eb9d3
Oct 27 04:56:08 nomad[6207]: github.com/hashicorp/nomad/vendor/github.com/hashicorp/go-msgpack/codec.(*Encoder).encodeValue(0xc42022a070, 0x1383ea0, 0xc4202bc058, 0x195)
Oct 27 04:56:08 nomad[6207]: #011/build/nomad-0.7.0/src/github.com/hashicorp/nomad/vendor/github.com/hashicorp/go-msgpack/codec/encode.go:899 +0x1c6 fp=0xc42087b5a8 sp=0xc42087b4b0 pc=0x7ed4a6
Oct 27 04:56:08 nomad[6207]: github.com/hashicorp/nomad/vendor/github.com/hashicorp/go-msgpack/codec.(*encFnInfo).kStruct(0xc4207c4690, 0x155fb80, 0xc4202bc000, 0x199)
Oct 27 04:56:08 nomad[6207]: #011/build/nomad-0.7.0/src/github.com/hashicorp/nomad/vendor/github.com/hashicorp/go-msgpack/codec/encode.go:502 +0x672 fp=0xc42087b6b0 sp=0xc42087b5a8 pc=0x7eb252
Oct 27 04:56:08 nomad[6207]: github.com/hashicorp/nomad/vendor/github.com/hashicorp/go-msgpack/codec.(*Encoder).encodeValue(0xc42022a070, 0x14ac180, 0xc4203b2740, 0x196)
Oct 27 04:56:08 nomad[6207]: #011/build/nomad-0.7.0/src/github.com/hashicorp/nomad/vendor/github.com/hashicorp/go-msgpack/codec/encode.go:899 +0x1c6 fp=0xc42087b7a8 sp=0xc42087b6b0 pc=0x7ed4a6
Oct 27 04:56:08 nomad[6207]: github.com/hashicorp/nomad/vendor/github.com/hashicorp/go-msgpack/codec.(*encFnInfo).kStruct(0xc4207c45a0, 0x14854c0, 0xc4203b2740, 0x199)
Oct 27 04:56:08 nomad[6207]: #011/build/nomad-0.7.0/src/github.com/hashicorp/nomad/vendor/github.com/hashicorp/go-msgpack/codec/encode.go:502 +0x672 fp=0xc42087b8b0 sp=0xc42087b7a8 pc=0x7eb252
Oct 27 04:56:08 nomad[6207]: github.com/hashicorp/nomad/vendor/github.com/hashicorp/go-msgpack/codec.(*Encoder).encodeValue(0xc42022a070, 0x147bf20, 0xc4203b2740, 0x16)
Oct 27 04:56:08 nomad[6207]: #011/build/nomad-0.7.0/src/github.com/hashicorp/nomad/vendor/github.com/hashicorp/go-msgpack/codec/encode.go:899 +0x1c6 fp=0xc42087b9a8 sp=0xc42087b8b0 pc=0x7ed4a6
Oct 27 04:56:08 nomad[6207]: github.com/hashicorp/nomad/vendor/github.com/hashicorp/go-msgpack/codec.(*Encoder).encode(0xc42022a070, 0x147bf20, 0xc4203b2740)
Oct 27 04:56:08 nomad[6207]: #011/build/nomad-0.7.0/src/github.com/hashicorp/nomad/vendor/github.com/hashicorp/go-msgpack/codec/encode.go:814 +0x10a fp=0xc42087b9e0 sp=0xc42087b9a8 pc=0x7ec15a
Oct 27 04:56:08 nomad[6207]: github.com/hashicorp/nomad/vendor/github.com/hashicorp/go-msgpack/codec.(*Encoder).Encode(0xc42022a070, 0x147bf20, 0xc4203b2740, 0x0, 0x0)
Oct 27 04:56:08 nomad[6207]: #011/build/nomad-0.7.0/src/github.com/hashicorp/nomad/vendor/github.com/hashicorp/go-msgpack/codec/encode.go:698 +0x7b fp=0xc42087ba08 sp=0xc42087b9e0 pc=0x7ec00b
Oct 27 04:56:08 nomad[6207]: github.com/hashicorp/nomad/vendor/github.com/hashicorp/net-rpc-msgpackrpc.(*MsgpackCodec).write(0xc4203b27c0, 0x12cde40, 0xc42053a600, 0x147bf20, 0xc4203b2740, 0x14369a0, 0xc420344801)
Oct 27 04:56:08 nomad[6207]: #011/build/nomad-0.7.0/src/github.com/hashicorp/nomad/vendor/github.com/hashicorp/net-rpc-msgpackrpc/codec.go:102 +0x8b fp=0xc42087ba40 sp=0xc42087ba08 pc=0xe83e3b
Oct 27 04:56:08 nomad[6207]: github.com/hashicorp/nomad/vendor/github.com/hashicorp/net-rpc-msgpackrpc.(*MsgpackCodec).WriteRequest(0xc4203b27c0, 0xc42053a600, 0x147bf20, 0xc4203b2740, 0x0, 0x0)
Oct 27 04:56:08 nomad[6207]: #011/build/nomad-0.7.0/src/github.com/hashicorp/nomad/vendor/github.com/hashicorp/net-rpc-msgpackrpc/codec.go:84 +0xaa fp=0xc42087ba90 sp=0xc42087ba40 pc=0xe83cea
Oct 27 04:56:08 nomad[6207]: github.com/hashicorp/nomad/vendor/github.com/hashicorp/net-rpc-msgpackrpc.CallWithCodec(0x1fcba00, 0xc4203b27c0, 0x15995b9, 0xd, 0x147bf20, 0xc4203b2740, 0x13e78c0, 0xc420013880, 0x0, 0x0)
Oct 27 04:56:08 nomad[6207]: #011/build/nomad-0.7.0/src/github.com/hashicorp/nomad/vendor/github.com/hashicorp/net-rpc-msgpackrpc/client.go:25 +0xc6 fp=0xc42087bb20 sp=0xc42087ba90 pc=0xe82ff6
Oct 27 04:56:08 nomad[6207]: github.com/hashicorp/nomad/nomad.(*ConnPool).RPC(0xc42039a000, 0x1590375, 0x6, 0x1fc3800, 0xc420acf8f0, 0x1, 0x15995b9, 0xd, 0x147bf20, 0xc4203b2740, ...)
Oct 27 04:56:08 nomad[6207]: #011/build/nomad-0.7.0/src/github.com/hashicorp/nomad/nomad/pool.go:363 +0x1a8 fp=0xc42087bbc0 sp=0xc42087bb20 pc=0xee09f8
Oct 27 04:56:08 nomad[6207]: github.com/hashicorp/nomad/client.(*Client).RPC(0xc42025a160, 0x15995b9, 0xd, 0x147bf20, 0xc4203b2740, 0x13e78c0, 0xc420013880, 0xc42087deb0, 0x3)
Oct 27 04:56:08 nomad[6207]: #011/build/nomad-0.7.0/src/github.com/hashicorp/nomad/client/client.go:457 +0x219 fp=0xc42087bcc0 sp=0xc42087bbc0 pc=0x10523f9
Oct 27 04:56:08 nomad[6207]: github.com/hashicorp/nomad/client.(*Client).registerNode(0xc42025a160, 0x0, 0x0)
Oct 27 04:56:08 nomad[6207]: #011/build/nomad-0.7.0/src/github.com/hashicorp/nomad/client/client.go:1155 +0x179 fp=0xc42087bd90 sp=0xc42087bcc0 pc=0x1058a19
Oct 27 04:56:08 nomad[6207]: github.com/hashicorp/nomad/client.(*Client).retryRegisterNode(0xc42025a160)
Oct 27 04:56:08 nomad[6207]: #011/build/nomad-0.7.0/src/github.com/hashicorp/nomad/client/client.go:1126 +0x43 fp=0xc42087bed0 sp=0xc42087bd90 pc=0x10585e3
Oct 27 04:56:08 nomad[6207]: github.com/hashicorp/nomad/client.(*Client).watchNodeUpdates(0xc42025a160)
Oct 27 04:56:08 nomad[6207]: #011/build/nomad-0.7.0/src/github.com/hashicorp/nomad/client/client.go:1510 +0x2de fp=0xc42087bfd8 sp=0xc42087bed0 pc=0x105b7fe
Oct 27 04:56:08 nomad[6207]: runtime.goexit()
Oct 27 04:56:08 nomad[6207]: #011/usr/local/go/src/runtime/asm_amd64.s:2337 +0x1 fp=0xc42087bfe0 sp=0xc42087bfd8 pc=0x45ee21
Oct 27 04:56:08 nomad[6207]: created by github.com/hashicorp/nomad/client.(*Client).registerAndHeartbeat
Oct 27 04:56:08 nomad[6207]: #011/build/nomad-0.7.0/src/github.com/hashicorp/nomad/client/client.go:1019 +0x68
Oct 27 04:56:08 nomad[6207]: goroutine 1 [select, 8587 minutes]:
Oct 27 04:56:08 nomad[6207]: github.com/hashicorp/nomad/command/agent.(*Command).handleSignals(0xc420012580, 0xc420201e00, 0xc420012580)
Oct 27 04:56:08 nomad[6207]: #011/build/nomad-0.7.0/src/github.com/hashicorp/nomad/command/agent/command.go:568 +0x223
Oct 27 04:56:08 nomad[6207]: github.com/hashicorp/nomad/command/agent.(*Command).Run(0xc420012580, 0xc4200100b0, 0x1, 0x1, 0x0)
Oct 27 04:56:08 nomad[6207]: #011/build/nomad-0.7.0/src/github.com/hashicorp/nomad/command/agent/command.go:557 +0xd52
Oct 27 04:56:08 nomad[6207]: github.com/hashicorp/nomad/vendor/github.com/mitchellh/cli.(*CLI).Run(0xc420200780, 0xc420200780, 0x4a, 0x15f9980)
Oct 27 04:56:08 nomad[6207]: #011/build/nomad-0.7.0/src/github.com/hashicorp/nomad/vendor/github.com/mitchellh/cli/cli.go:255 +0x1eb
Oct 27 04:56:08 nomad[6207]: main.RunCustom(0xc4200100a0, 0x2, 0x2, 0xc420306360, 0xc4204d5f60)
Oct 27 04:56:08 nomad[6207]: #011/build/nomad-0.7.0/src/github.com/hashicorp/nomad/main.go:61 +0x1806
Oct 27 04:56:08 nomad[6207]: main.Run(0xc4200100a0, 0x2, 0x2, 0x11e9586)
Oct 27 04:56:08 nomad[6207]: #011/build/nomad-0.7.0/src/github.com/hashicorp/nomad/main.go:24 +0x56
Oct 27 04:56:08 nomad[6207]: main.main()
Oct 27 04:56:08 nomad[6207]: #011/build/nomad-0.7.0/src/github.com/hashicorp/nomad/main.go:20 +0x63
Oct 27 04:56:08 nomad[6207]: goroutine 5 [syscall, 8587 minutes]:
Oct 27 04:56:08 nomad[6207]: os/signal.signal_recv(0x1fc5480)
Oct 27 04:56:08 nomad[6207]: #011/usr/local/go/src/runtime/sigqueue.go:131 +0xa6
Oct 27 04:56:08 nomad[6207]: os/signal.loop()
Oct 27 04:56:08 nomad[6207]: #011/usr/local/go/src/os/signal/signal_unix.go:22 +0x22
Oct 27 04:56:08 nomad[6207]: created by os/signal.init.0
Oct 27 04:56:08 nomad[6207]: #011/usr/local/go/src/os/signal/signal_unix.go:28 +0x41
Oct 27 04:56:08 nomad[6207]: goroutine 50 [select, 1865 minutes]:
Oct 27 04:56:08 nomad[6207]: github.com/hashicorp/nomad/command/agent/consul.(*ServiceClient).Run(0xc4200ea180)
Oct 27 04:56:08 nomad[6207]: #011/build/nomad-0.7.0/src/github.com/hashicorp/nomad/command/agent/consul/client.go:281 +0x2a1
Oct 27 04:56:08 nomad[6207]: created by github.com/hashicorp/nomad/command/agent.(*Agent).setupConsul
Oct 27 04:56:08 nomad[6207]: #011/build/nomad-0.7.0/src/github.com/hashicorp/nomad/command/agent/agent.go:745 +0x18e
Oct 27 04:56:08 nomad[6207]: goroutine 37 [select, 8592 minutes, locked to thread]:
Oct 27 04:56:08 nomad[6207]: runtime.gopark(0x15fa278, 0x0, 0x1590b07, 0x6, 0x18, 0x1)
Oct 27 04:56:08 nomad[6207]: #011/usr/local/go/src/runtime/proc.go:277 +0x12c
Oct 27 04:56:08 nomad[6207]: runtime.selectgo(0xc420104f50, 0xc4200625a0)
Oct 27 04:56:08 nomad[6207]: #011/usr/local/go/src/runtime/select.go:395 +0x1138
Oct 27 04:56:08 nomad[6207]: runtime.ensureSigM.func1()
Oct 27 04:56:08 nomad[6207]: #011/usr/local/go/src/runtime/signal_unix.go:511 +0x220
Oct 27 04:56:08 nomad[6207]: runtime.goexit()
Oct 27 04:56:08 nomad[6207]: #011/usr/local/go/src/runtime/asm_amd64.s:2337 +0x1
Oct 27 04:56:08 nomad[6207]: goroutine 38 [select, 8592 minutes]:
Oct 27 04:56:08 nomad[6207]: github.com/hashicorp/nomad/vendor/github.com/armon/go-metrics.(*InmemSignal).run(0xc420356c00)
Oct 27 04:56:08 nomad[6207]: #011/build/nomad-0.7.0/src/github.com/hashicorp/nomad/vendor/github.com/armon/go-metrics/inmem_signal.go:64 +0xf8
Oct 27 04:56:08 nomad[6207]: created by github.com/hashicorp/nomad/vendor/github.com/armon/go-metrics.NewInmemSignal
Oct 27 04:56:08 nomad[6207]: #011/build/nomad-0.7.0/src/github.com/hashicorp/nomad/vendor/github.com/armon/go-metrics/inmem_signal.go:38 +0x162
Oct 27 04:56:08 nomad[6207]: goroutine 39 [sleep]:
Oct 27 04:56:08 nomad[6207]: time.Sleep(0x3b9aca00)
Oct 27 04:56:08 nomad[6207]: #011/usr/local/go/src/runtime/time.go:65 +0x130
Oct 27 04:56:08 nomad[6207]: github.com/hashicorp/nomad/vendor/github.com/armon/go-metrics.(*Metrics).collectStats(0xc4201ff290)
Oct 27 04:56:08 nomad[6207]: #011/build/nomad-0.7.0/src/github.com/hashicorp/nomad/vendor/github.com/armon/go-metrics/metrics.go:168 +0x2f
Oct 27 04:56:08 nomad[6207]: created by github.com/hashicorp/nomad/vendor/github.com/armon/go-metrics.New
Oct 27 04:56:08 nomad[6207]: #011/build/nomad-0.7.0/src/github.com/hashicorp/nomad/vendor/github.com/armon/go-metrics/start.go:75 +0x12b
Oct 27 04:56:08 nomad[6207]: goroutine 9 [select, 8592 minutes]:
Oct 27 04:56:08 nomad[6207]: github.com/hashicorp/nomad/command/agent/consul.(*checkWatcher).Run(0xc420054180, 0x1fcb1c0, 0xc4201d8140)
Oct 27 04:56:08 nomad[6207]: #011/build/nomad-0.7.0/src/github.com/hashicorp/nomad/command/agent/consul/check_watcher.go:186 +0x297
Oct 27 04:56:08 nomad[6207]: created by github.com/hashicorp/nomad/command/agent/consul.(*ServiceClient).Run
Oct 27 04:56:08 nomad[6207]: #011/build/nomad-0.7.0/src/github.com/hashicorp/nomad/command/agent/consul/client.go:275 +0xf6
Oct 27 04:56:08 nomad[6207]: goroutine 45 [runnable]:
Oct 27 04:56:08 nomad[6207]: net/url.Parse(0x159a602, 0xe, 0x1, 0x1, 0xc420535a00)
Oct 27 04:56:08 nomad[6207]: #011/usr/local/go/src/net/url/url.go:431 +0x3e7
Oct 27 04:56:08 nomad[6207]: net/http.NewRequest(0x158cac0, 0x3, 0x159a602, 0xe, 0x0, 0x0, 0xc42067c880, 0xc4201d5e30, 0x0)
Oct 27 04:56:08 nomad[6207]: #011/usr/local/go/src/net/http/request.go:775 +0x9f
Oct 27 04:56:08 nomad[6207]: github.com/hashicorp/nomad/vendor/github.com/hashicorp/consul/api.(*request).toHTTP(0xc4206cf440, 0xc4207b8e00, 0xc4206cf440, 0x70d1b0)
Oct 27 04:56:08 nomad[6207]: #011/build/nomad-0.7.0/src/github.com/hashicorp/nomad/vendor/github.com/hashicorp/consul/api/api.go:610 +0xbb
Oct 27 04:56:08 nomad[6207]: github.com/hashicorp/nomad/vendor/github.com/hashicorp/consul/api.(*Client).doRequest(0xc4200ea840, 0xc4206cf440, 0x3, 0x159a602, 0xe, 0xc4206cf440)
Oct 27 04:56:08 nomad[6207]: #011/build/nomad-0.7.0/src/github.com/hashicorp/nomad/vendor/github.com/hashicorp/consul/api/api.go:658 +0x32
Oct 27 04:56:08 nomad[6207]: github.com/hashicorp/nomad/vendor/github.com/hashicorp/consul/api.(*Agent).Self(0xc420535e18, 0x0, 0x0, 0x0)
Oct 27 04:56:08 nomad[6207]: #011/build/nomad-0.7.0/src/github.com/hashicorp/nomad/vendor/github.com/hashicorp/consul/api/agent.go:165 +0x92
Oct 27 04:56:08 nomad[6207]: github.com/hashicorp/nomad/client/fingerprint.(*ConsulFingerprint).Fingerprint(0xc4201dc8a0, 0xc42025a000, 0xc4202bc000, 0x0, 0x0, 0x0)
Oct 27 04:56:08 nomad[6207]: #011/build/nomad-0.7.0/src/github.com/hashicorp/nomad/client/fingerprint/consul.go:54 +0xa5
Oct 27 04:56:08 nomad[6207]: github.com/hashicorp/nomad/client.(*Client).fingerprintPeriodic(0xc42025a160, 0x1590123, 0x6, 0x1fc1e00, 0xc4201dc8a0, 0x37e11d600)
Oct 27 04:56:08 nomad[6207]: #011/build/nomad-0.7.0/src/github.com/hashicorp/nomad/client/client.go:941 +0x282
Oct 27 04:56:08 nomad[6207]: created by github.com/hashicorp/nomad/client.(*Client).fingerprint
Oct 27 04:56:08 nomad[6207]: #011/build/nomad-0.7.0/src/github.com/hashicorp/nomad/client/client.go:924 +0x6d0
Oct 27 04:56:08 nomad[6207]: goroutine 51 [select]:
Oct 27 04:56:08 systemd[1]: nomad-agent.service: Main process exited, code=exited, status=2/INVALIDARGUMENT
Oct 27 04:56:08 nomad[6207]: github.com/hashicorp/nomad/nomad.(*ConnPool).reap(0xc42039a000)
Oct 27 04:56:08 nomad[6207]: #011/build/nomad-0.7.0/src/github.com/hashicorp/nomad/nomad/pool.go:380 +0x37b
Oct 27 04:56:08 nomad[6207]: created by github.com/hashicorp/nomad/nomad.NewPool
Oct 27 04:56:08 nomad[6207]: #011/build/nomad-0.7.0/src/github.com/hashicorp/nomad/nomad/pool.go:155 +0x179
Oct 27 04:56:08 nomad[6207]: goroutine 52 [select]:
Oct 27 04:56:08 nomad[6207]: github.com/hashicorp/nomad/client.(*AllocGarbageCollector).Run(0xc42039a140)
Oct 27 04:56:08 nomad[6207]: #011/build/nomad-0.7.0/src/github.com/hashicorp/nomad/client/gc.go:75 +0x10e
Oct 27 04:56:08 nomad[6207]: created by github.com/hashicorp/nomad/client.NewClient
Oct 27 04:56:08 nomad[6207]: #011/build/nomad-0.7.0/src/github.com/hashicorp/nomad/client/client.go:222 +0x6dd
Oct 27 04:56:08 nomad[6207]: goroutine 11 [select]:
Oct 27 04:56:08 nomad[6207]: net/http.(*persistConn).writeLoop(0xc4205d4ea0)
Oct 27 04:56:08 nomad[6207]: #011/usr/local/go/src/net/http/transport.go:1759 +0x165
Oct 27 04:56:08 nomad[6207]: created by net/http.(*Transport).dialConn
Oct 27 04:56:08 nomad[6207]: #011/usr/local/go/src/net/http/transport.go:1187 +0xa53
Oct 27 04:56:08 nomad[6207]: goroutine 26 [select, 3 minutes]:
Oct 27 04:56:08 nomad[6207]: github.com/hashicorp/nomad/vendor/github.com/hashicorp/yamux.(*Stream).Read(0xc420842a90, 0xc420934000, 0x1000, 0x1000, 0x0, 0x0, 0x0)
Oct 27 04:56:08 nomad[6207]: #011/build/nomad-0.7.0/src/github.com/hashicorp/nomad/vendor/github.com/hashicorp/yamux/stream.go:125 +0x270
Oct 27 04:56:08 nomad[6207]: bufio.(*Reader).fill(0xc420a64ae0)
Oct 27 04:56:08 nomad[6207]: #011/usr/local/go/src/bufio/bufio.go:97 +0x11a
Oct 27 04:56:08 nomad[6207]: bufio.(*Reader).ReadByte(0xc420a64ae0, 0xc42001a000, 0xc42001a070, 0xc42001a000)
Oct 27 04:56:08 nomad[6207]: #011/usr/local/go/src/bufio/bufio.go:239 +0x39
Oct 27 04:56:08 nomad[6207]: github.com/hashicorp/nomad/vendor/github.com/hashicorp/go-msgpack/codec.(*ioDecReader).readn1(0xc4205005a0, 0xc4207816c0)
Oct 27 04:56:08 nomad[6207]: #011/build/nomad-0.7.0/src/github.com/hashicorp/nomad/vendor/github.com/hashicorp/go-msgpack/codec/decode.go:90 +0x7a
Oct 27 04:56:08 nomad[6207]: github.com/hashicorp/nomad/vendor/github.com/hashicorp/go-msgpack/codec.(*msgpackDecDriver).initReadNext(0xc4200d0e40)
Oct 27 04:56:08 nomad[6207]: #011/build/nomad-0.7.0/src/github.com/hashicorp/nomad/vendor/github.com/hashicorp/go-msgpack/codec/msgpack.go:540 +0x45
Oct 27 04:56:08 nomad[6207]: github.com/hashicorp/nomad/vendor/github.com/hashicorp/go-msgpack/codec.(*Decoder).decode(0xc420a64b40, 0x12cde80, 0xc42030b620)
Oct 27 04:56:08 nomad[6207]: #011/build/nomad-0.7.0/src/github.com/hashicorp/nomad/vendor/github.com/hashicorp/go-msgpack/codec/decode.go:635 +0x49
Oct 27 04:56:08 systemd[1]: nomad-agent.service: Unit entered failed state.
Oct 27 04:56:08 nomad[6207]: github.com/hashicorp/nomad/vendor/github.com/hashicorp/go-msgpack/codec.(*Decoder).Decode(0xc420a64b40, 0x12cde80, 0xc42030b620, 0x0, 0x0)
Oct 27 04:56:08 nomad[6207]: #011/build/nomad-0.7.0/src/github.com/hashicorp/nomad/vendor/github.com/hashicorp/go-msgpack/codec/decode.go:630 +0x7b
Oct 27 04:56:08 nomad[6207]: github.com/hashicorp/nomad/vendor/github.com/hashicorp/net-rpc-msgpackrpc.(*MsgpackCodec).read(0xc420a6c980, 0x12cde80, 0xc42030b620, 0x1, 0xc42030b620)
Oct 27 04:56:08 nomad[6207]: #011/build/nomad-0.7.0/src/github.com/hashicorp/nomad/vendor/github.com/hashicorp/net-rpc-msgpackrpc/codec.go:121 +0x57
Oct 27 04:56:08 nomad[6207]: github.com/hashicorp/nomad/vendor/github.com/hashicorp/net-rpc-msgpackrpc.(*MsgpackCodec).ReadResponseHeader(0xc420a6c980, 0xc42030b620, 0x147c000, 0xc4204fe000)
Oct 27 04:56:08 nomad[6207]: #011/build/nomad-0.7.0/src/github.com/hashicorp/nomad/vendor/github.com/hashicorp/net-rpc-msgpackrpc/codec.go:74 +0x41
Oct 27 04:56:08 nomad[6207]: github.com/hashicorp/nomad/vendor/github.com/hashicorp/net-rpc-msgpackrpc.CallWithCodec(0x1fcba00, 0xc420a6c980, 0x15a3902, 0x14, 0x147c000, 0xc4204fe000, 0x13e75a0, 0xc4206a6000, 0x0, 0x0)
Oct 27 04:56:08 nomad[6207]: #011/build/nomad-0.7.0/src/github.com/hashicorp/nomad/vendor/github.com/hashicorp/net-rpc-msgpackrpc/client.go:29 +0x10d
Oct 27 04:56:08 nomad[6207]: github.com/hashicorp/nomad/nomad.(*ConnPool).RPC(0xc42039a000, 0x1590375, 0x6, 0x1fc3800, 0xc420acf8f0, 0x1, 0x15a3902, 0x14, 0x147c000, 0xc4204fe000, ...)
Oct 27 04:56:08 nomad[6207]: #011/build/nomad-0.7.0/src/github.com/hashicorp/nomad/nomad/pool.go:363 +0x1a8
Oct 27 04:56:08 nomad[6207]: github.com/hashicorp/nomad/client.(*Client).RPC(0xc42025a160, 0x15a3902, 0x14, 0x147c000, 0xc4204fe000, 0x13e75a0, 0xc4206a6000, 0x0, 0x0)
Oct 27 04:56:08 nomad[6207]: #011/build/nomad-0.7.0/src/github.com/hashicorp/nomad/client/client.go:457 +0x219
Oct 27 04:56:08 nomad[6207]: github.com/hashicorp/nomad/client.(*Client).watchAllocations(0xc42025a160, 0xc4201eed80)
Oct 27 04:56:08 nomad[6207]: #011/build/nomad-0.7.0/src/github.com/hashicorp/nomad/client/client.go:1354 +0x280
Oct 27 04:56:08 nomad[6207]: created by github.com/hashicorp/nomad/client.(*Client).run
Oct 27 04:56:08 nomad[6207]: #011/build/nomad-0.7.0/src/github.com/hashicorp/nomad/client/client.go:1087 +0x7c
Oct 27 04:56:08 nomad[6207]: goroutine 55 [semacquire]:
Oct 27 04:56:08 nomad[6207]: sync.runtime_SemacquireMutex(0xc42025a194, 0xc420034e00)
Oct 27 04:56:08 nomad[6207]: #011/usr/local/go/src/runtime/sema.go:71 +0x3d
Oct 27 04:56:08 nomad[6207]: sync.(*Mutex).Lock(0xc42025a190)
Oct 27 04:56:08 systemd[1]: nomad-agent.service: Failed with result 'exit-code'.
Oct 27 04:56:08 nomad[6207]: #011/usr/local/go/src/sync/mutex.go:134 +0xee
Oct 27 04:56:08 nomad[6207]: sync.(*RWMutex).Lock(0xc42025a190)
Oct 27 04:56:08 nomad[6207]: #011/usr/local/go/src/sync/rwmutex.go:93 +0x2d
Oct 27 04:56:08 nomad[6207]: github.com/hashicorp/nomad/client.(*Client).fingerprintPeriodic(0xc42025a160, 0x15900db, 0x6, 0x1fc1d80, 0xc4205cecf0, 0x37e11d600)
Oct 27 04:56:08 nomad[6207]: #011/build/nomad-0.7.0/src/github.com/hashicorp/nomad/client/client.go:940 +0x24c
Oct 27 04:56:08 nomad[6207]: created by github.com/hashicorp/nomad/client.(*Client).fingerprint
Oct 27 04:56:08 nomad[6207]: #011/build/nomad-0.7.0/src/github.com/hashicorp/nomad/client/client.go:924 +0x6d0
Oct 27 04:56:08 nomad[6207]: goroutine 664277 [semacquire, 1869 minutes]:
Oct 27 04:56:08 nomad[6207]: sync.runtime_notifyListWait(0xc4203ac1c0, 0xc400000001)
Oct 27 04:56:08 nomad[6207]: #011/usr/local/go/src/runtime/sema.go:507 +0x110
Oct 27 04:56:08 nomad[6207]: sync.(*Cond).Wait(0xc4203ac1b0)
Oct 27 04:56:08 nomad[6207]: #011/usr/local/go/src/sync/cond.go:56 +0x80
Oct 27 04:56:08 nomad[6207]: io.(*pipe).read(0xc4203ac180, 0xc4207c6000, 0x1000, 0x1000, 0x0, 0x0, 0x0)
Oct 27 04:56:08 nomad[6207]: #011/usr/local/go/src/io/pipe.go:47 +0xc6
Oct 27 04:56:08 nomad[6207]: io.(*PipeReader).Read(0xc4201c40b0, 0xc4207c6000, 0x1000, 0x1000, 0x7f05e6bff5e8, 0x0, 0x0)
Oct 27 04:56:08 nomad[6207]: #011/usr/local/go/src/io/pipe.go:130 +0x4c
Oct 27 04:56:08 nomad[6207]: bufio.(*Reader).fill(0xc420044f68)
Oct 27 04:56:08 nomad[6207]: #011/usr/local/go/src/bufio/bufio.go:97 +0x11a
Oct 27 04:56:08 nomad[6207]: bufio.(*Reader).ReadSlice(0xc420044f68, 0xc420044e0a, 0x405fa8, 0xc4202b93e0, 0xc42093cf00, 0xc420044ef8, 0xc420044e58)
Oct 27 04:56:08 nomad[6207]: #011/usr/local/go/src/bufio/bufio.go:338 +0x2c
Oct 27 04:56:08 nomad[6207]: bufio.(*Reader).ReadBytes(0xc420044f68, 0xc420044e0a, 0xc4207498c0, 0x25, 0x25, 0x0, 0x0)
Oct 27 04:56:08 nomad[6207]: #011/usr/local/go/src/bufio/bufio.go:416 +0x6b
Oct 27 04:56:08 nomad[6207]: github.com/hashicorp/nomad/vendor/github.com/hashicorp/go-plugin.(*Client).Start.func4(0xc4202b93e0, 0xc4201c40b0)
Oct 27 04:56:08 nomad[6207]: #011/build/nomad-0.7.0/src/github.com/hashicorp/nomad/vendor/github.com/hashicorp/go-plugin/client.go:555 +0x16c
Oct 27 04:56:08 nomad[6207]: created by github.com/hashicorp/nomad/vendor/github.com/hashicorp/go-plugin.(*Client).Start
Oct 27 04:56:08 nomad[6207]: #011/build/nomad-0.7.0/src/github.com/hashicorp/nomad/vendor/github.com/hashicorp/go-plugin/client.go:550 +0xdaf
Oct 27 04:56:08 nomad[6207]: goroutine 10 [IO wait]:
Oct 27 04:56:08 nomad[6207]: internal/poll.runtime_pollWait(0x7f05e6ce1eb0, 0x72, 0x0)
Oct 27 04:56:08 nomad[6207]: #011/usr/local/go/src/runtime/netpoll.go:173 +0x57
Oct 27 04:56:08 nomad[6207]: internal/poll.(*pollDesc).wait(0xc420012998, 0x72, 0xffffffffffffff00, 0x1fc0ac0, 0x1fb92d8)
Oct 27 04:56:08 nomad[6207]: #011/usr/local/go/src/internal/poll/fd_poll_runtime.go:85 +0xae
Oct 27 04:56:08 nomad[6207]: internal/poll.(*pollDesc).waitRead(0xc420012998, 0xc420400000, 0x1000, 0x1000)
Oct 27 04:56:08 nomad[6207]: #011/usr/local/go/src/internal/poll/fd_poll_runtime.go:90 +0x3d
Oct 27 04:56:08 nomad[6207]: internal/poll.(*FD).Read(0xc420012980, 0xc420400000, 0x1000, 0x1000, 0x0, 0x0, 0x0)
Oct 27 04:56:08 nomad[6207]: #011/usr/local/go/src/internal/poll/fd_unix.go:125 +0x18a
Oct 27 04:56:08 nomad[6207]: net.(*netFD).Read(0xc420012980, 0xc420400000, 0x1000, 0x1000, 0x42f78b, 0xc42056ea40, 0x45aea0)
Oct 27 04:56:08 nomad[6207]: #011/usr/local/go/src/net/fd_unix.go:202 +0x52
Oct 27 04:56:08 nomad[6207]: net.(*conn).Read(0xc4201de018, 0xc420400000, 0x1000, 0x1000, 0x0, 0x0, 0x0)
Oct 27 04:56:08 nomad[6207]: #011/usr/local/go/src/net/net.go:176 +0x6d
Oct 27 04:56:08 nomad[6207]: net/http.(*persistConn).Read(0xc4205d4ea0, 0xc420400000, 0x1000, 0x1000, 0xc4202fb530, 0xc4202b8178, 0x458f00)
Oct 27 04:56:08 nomad[6207]: #011/usr/local/go/src/net/http/transport.go:1391 +0x140
Oct 27 04:56:08 nomad[6207]: bufio.(*Reader).fill(0xc4203441e0)
Oct 27 04:56:08 nomad[6207]: #011/usr/local/go/src/bufio/bufio.go:97 +0x11a
Oct 27 04:56:08 nomad[6207]: bufio.(*Reader).Peek(0xc4203441e0, 0x1, 0x0, 0x0, 0x0, 0xc4207e0a20, 0x0)
Oct 27 04:56:08 nomad[6207]: #011/usr/local/go/src/bufio/bufio.go:129 +0x3a
Oct 27 04:56:08 nomad[6207]: net/http.(*persistConn).readLoop(0xc4205d4ea0)
Oct 27 04:56:08 nomad[6207]: #011/usr/local/go/src/net/http/transport.go:1539 +0x185
Oct 27 04:56:08 nomad[6207]: created by net/http.(*Transport).dialConn
Oct 27 04:56:08 nomad[6207]: #011/usr/local/go/src/net/http/transport.go:1186 +0xa2e
Oct 27 04:56:08 nomad[6207]: goroutine 104 [select]:
Oct 27 04:56:08 nomad[6207]: github.com/hashicorp/nomad/vendor/github.com/hashicorp/yamux.(*Session).send(0xc4207002c0)
Oct 27 04:56:08 nomad[6207]: #011/build/nomad-0.7.0/src/github.com/hashicorp/nomad/vendor/github.com/hashicorp/yamux/session.go:368 +0x2ca
Oct 27 04:56:08 nomad[6207]: created by github.com/hashicorp/nomad/vendor/github.com/hashicorp/yamux.newSession
Oct 27 04:56:08 nomad[6207]: #011/build/nomad-0.7.0/src/github.com/hashicorp/nomad/vendor/github.com/hashicorp/yamux/session.go:109 +0x406
Oct 27 04:56:08 nomad[6207]: goroutine 663715 [select, 1872 minutes]:
Oct 27 04:56:08 nomad[6207]: github.com/hashicorp/nomad/client.(*TaskRunner).run(0xc420840ea0)
Oct 27 04:56:08 nomad[6207]: #011/build/nomad-0.7.0/src/github.com/hashicorp/nomad/client/task_runner.go:1098 +0x2cc
Oct 27 04:56:08 nomad[6207]: github.com/hashicorp/nomad/client.(*TaskRunner).Run(0xc420840ea0)
Oct 27 04:56:08 nomad[6207]: #011/build/nomad-0.7.0/src/github.com/hashicorp/nomad/client/task_runner.go:622 +0x509
Oct 27 04:56:08 nomad[6207]: created by github.com/hashicorp/nomad/client.(*AllocRunner).Run
Oct 27 04:56:08 nomad[6207]: #011/build/nomad-0.7.0/src/github.com/hashicorp/nomad/client/alloc_runner.go:812 +0x89c
Oct 27 04:56:08 nomad[6207]: goroutine 77 [semacquire]:
Oct 27 04:56:08 nomad[6207]: sync.runtime_SemacquireMutex(0xc42025a194, 0xc4206b1e00)
Oct 27 04:56:08 nomad[6207]: #011/usr/local/go/src/runtime/sema.go:71 +0x3d
Oct 27 04:56:08 nomad[6207]: sync.(*Mutex).Lock(0xc42025a190)
Oct 27 04:56:08 nomad[6207]: #011/usr/local/go/src/sync/mutex.go:134 +0xee
Oct 27 04:56:08 nomad[6207]: sync.(*RWMutex).Lock(0xc42025a190)
Oct 27 04:56:08 nomad[6207]: #011/usr/local/go/src/sync/rwmutex.go:93 +0x2d
Oct 27 04:56:08 nomad[6207]: github.com/hashicorp/nomad/client.(*Client).fingerprintPeriodic(0xc42025a160, 0x158da73, 0x4, 0x7f05e6c50af8, 0xc4201d2190, 0x37e11d600)
Oct 27 04:56:08 nomad[6207]: #011/build/nomad-0.7.0/src/github.com/hashicorp/nomad/client/client.go:940 +0x24c
Oct 27 04:56:08 nomad[6207]: created by github.com/hashicorp/nomad/client.(*Client).setupDrivers
Oct 27 04:56:08 nomad[6207]: #011/build/nomad-0.7.0/src/github.com/hashicorp/nomad/client/client.go:990 +0x5fb
Oct 27 04:56:08 nomad[6207]: goroutine 663697 [select, 1872 minutes]:
Oct 27 04:56:08 nomad[6207]: github.com/hashicorp/nomad/client.(*AllocRunner).dirtySyncState(0xc4200791e0)
Oct 27 04:56:08 nomad[6207]: #011/build/nomad-0.7.0/src/github.com/hashicorp/nomad/client/alloc_runner.go:576 +0xfe
Oct 27 04:56:08 nomad[6207]: created by github.com/hashicorp/nomad/client.(*AllocRunner).Run
Oct 27 04:56:08 nomad[6207]: #011/build/nomad-0.7.0/src/github.com/hashicorp/nomad/client/alloc_runner.go:736 +0x8b
Oct 27 04:56:08 nomad[6207]: goroutine 664772 [select]:
Oct 27 04:56:08 nomad[6207]: github.com/hashicorp/nomad/vendor/github.com/hashicorp/yamux.(*Session).send(0xc420b88f20)
Oct 27 04:56:08 nomad[6207]: #011/build/nomad-0.7.0/src/github.com/hashicorp/nomad/vendor/github.com/hashicorp/yamux/session.go:368 +0x2ca
Oct 27 04:56:08 nomad[6207]: created by github.com/hashicorp/nomad/vendor/github.com/hashicorp/yamux.newSession
Oct 27 04:56:08 nomad[6207]: #011/build/nomad-0.7.0/src/github.com/hashicorp/nomad/vendor/github.com/hashicorp/yamux/session.go:109 +0x406
Oct 27 04:56:08 nomad[6207]: goroutine 98 [select]:
Oct 27 04:56:08 nomad[6207]: github.com/hashicorp/nomad/client.(*Client).fingerprintPeriodic(0xc42025a160, 0x158f568, 0x5, 0x1fc2040, 0xc420326340, 0x37e11d600)
Oct 27 04:56:08 nomad[6207]: #011/build/nomad-0.7.0/src/github.com/hashicorp/nomad/client/client.go:938 +0x224
Oct 27 04:56:08 nomad[6207]: created by github.com/hashicorp/nomad/client.(*Client).fingerprint
Oct 27 04:56:08 nomad[6207]: #011/build/nomad-0.7.0/src/github.com/hashicorp/nomad/client/client.go:924 +0x6d0
Oct 27 04:56:08 nomad[6207]: goroutine 105 [select]:
Oct 27 04:56:08 nomad[6207]: github.com/hashicorp/nomad/vendor/github.com/hashicorp/yamux.(*Session).keepalive(0xc4207002c0)
Oct 27 04:56:08 nomad[6207]: #011/build/nomad-0.7.0/src/github.com/hashicorp/nomad/vendor/github.com/hashicorp/yamux/session.go:302 +0x102
Oct 27 04:56:08 nomad[6207]: created by github.com/hashicorp/nomad/vendor/github.com/hashicorp/yamux.newSession
Oct 27 04:56:08 nomad[6207]: #011/build/nomad-0.7.0/src/github.com/hashicorp/nomad/vendor/github.com/hashicorp/yamux/session.go:111 +0x455
Oct 27 04:56:08 nomad[6207]: goroutine 78 [select]:
Oct 27 04:56:08 nomad[6207]: github.com/hashicorp/nomad/client.(*Client).fingerprintPeriodic(0xc42025a160, 0x158cf25, 0x3, 0x7f05e6c50b28, 0xc4201d2320, 0x37e11d600)
Oct 27 04:56:08 nomad[6207]: #011/build/nomad-0.7.0/src/github.com/hashicorp/nomad/client/client.go:938 +0x224
Oct 27 04:56:08 nomad[6207]: created by github.com/hashicorp/nomad/client.(*Client).setupDrivers
Oct 27 04:56:08 nomad[6207]: #011/build/nomad-0.7.0/src/github.com/hashicorp/nomad/client/client.go:990 +0x5fb
Oct 27 04:56:08 nomad[6207]: goroutine 81 [select, 1470 minutes]:
Oct 27 04:56:08 nomad[6207]: github.com/hashicorp/nomad/client/vaultclient.(*vaultClient).run(0xc420059d40)
Oct 27 04:56:08 nomad[6207]: #011/build/nomad-0.7.0/src/github.com/hashicorp/nomad/client/vaultclient/vaultclient.go:530 +0x233
Oct 27 04:56:08 nomad[6207]: created by github.com/hashicorp/nomad/client/vaultclient.(*vaultClient).Start
Oct 27 04:56:08 nomad[6207]: #011/build/nomad-0.7.0/src/github.com/hashicorp/nomad/client/vaultclient/vaultclient.go:197 +0x96
Oct 27 04:56:08 nomad[6207]: goroutine 76 [semacquire]:
Oct 27 04:56:08 nomad[6207]: sync.runtime_SemacquireMutex(0xc42025a194, 0xc4207dbe00)
Oct 27 04:56:08 nomad[6207]: #011/usr/local/go/src/runtime/sema.go:71 +0x3d
Oct 27 04:56:08 nomad[6207]: sync.(*Mutex).Lock(0xc42025a190)
Oct 27 04:56:08 nomad[6207]: #011/usr/local/go/src/sync/mutex.go:134 +0xee
Oct 27 04:56:08 nomad[6207]: sync.(*RWMutex).Lock(0xc42025a190)
Oct 27 04:56:08 nomad[6207]: #011/usr/local/go/src/sync/rwmutex.go:93 +0x2d
Oct 27 04:56:08 nomad[6207]: github.com/hashicorp/nomad/client.(*Client).fingerprintPeriodic(0xc42025a160, 0x15901fb, 0x6, 0x7f05e6c50ac8, 0xc420059260, 0x37e11d600)
Oct 27 04:56:08 nomad[6207]: #011/build/nomad-0.7.0/src/github.com/hashicorp/nomad/client/client.go:940 +0x24c
Oct 27 04:56:08 nomad[6207]: created by github.com/hashicorp/nomad/client.(*Client).setupDrivers
Oct 27 04:56:08 nomad[6207]: #011/build/nomad-0.7.0/src/github.com/hashicorp/nomad/client/client.go:990 +0x5fb
Oct 27 04:56:08 nomad[6207]: goroutine 79 [select]:
Oct 27 04:56:08 nomad[6207]: github.com/hashicorp/nomad/client.(*Client).consulDiscovery(0xc42025a160)
Oct 27 04:56:08 nomad[6207]: #011/build/nomad-0.7.0/src/github.com/hashicorp/nomad/client/client.go:1756 +0xeb
Oct 27 04:56:08 nomad[6207]: created by github.com/hashicorp/nomad/client.NewClient
Oct 27 04:56:08 nomad[6207]: #011/build/nomad-0.7.0/src/github.com/hashicorp/nomad/client/client.go:259 +0xe85
Oct 27 04:56:08 nomad[6207]: goroutine 103 [runnable]:
Oct 27 04:56:08 nomad[6207]: internal/poll.runtime_pollWait(0x7f05e6ce1af0, 0x72, 0x0)
Oct 27 04:56:08 nomad[6207]: #011/usr/local/go/src/runtime/netpoll.go:173 +0x57
Oct 27 04:56:08 nomad[6207]: internal/poll.(*pollDesc).wait(0xc420013e18, 0x72, 0xffffffffffffff00, 0x1fc0ac0, 0x1fb92d8)
Oct 27 04:56:08 nomad[6207]: #011/usr/local/go/src/internal/poll/fd_poll_runtime.go:85 +0xae
Oct 27 04:56:08 nomad[6207]: internal/poll.(*pollDesc).waitRead(0xc420013e18, 0xc420666000, 0x1000, 0x1000)
Oct 27 04:56:08 nomad[6207]: #011/usr/local/go/src/internal/poll/fd_poll_runtime.go:90 +0x3d
Oct 27 04:56:08 nomad[6207]: internal/poll.(*FD).Read(0xc420013e00, 0xc420666000, 0x1000, 0x1000, 0x0, 0x0, 0x0)
Oct 27 04:56:08 nomad[6207]: #011/usr/local/go/src/internal/poll/fd_unix.go:125 +0x18a
Oct 27 04:56:08 nomad[6207]: net.(*netFD).Read(0xc420013e00, 0xc420666000, 0x1000, 0x1000, 0xc4206929c0, 0xc4202e6d78, 0x0)
Oct 27 04:56:08 nomad[6207]: #011/usr/local/go/src/net/fd_unix.go:202 +0x52
Oct 27 04:56:08 nomad[6207]: net.(*conn).Read(0xc420312030, 0xc420666000, 0x1000, 0x1000, 0x0, 0x0, 0x0)
Oct 27 04:56:08 nomad[6207]: #011/usr/local/go/src/net/net.go:176 +0x6d
Oct 27 04:56:08 nomad[6207]: bufio.(*Reader).Read(0xc420344540, 0xc4204f7810, 0xc, 0xc, 0xc4204fb460, 0x7f05e6ce6d68, 0x0)
Oct 27 04:56:08 nomad[6207]: #011/usr/local/go/src/bufio/bufio.go:213 +0x30b
Oct 27 04:56:08 nomad[6207]: io.ReadAtLeast(0x1fbaec0, 0xc420344540, 0xc4204f7810, 0xc, 0xc, 0xc, 0xc, 0x0, 0x0)
Oct 27 04:56:08 nomad[6207]: #011/usr/local/go/src/io/io.go:309 +0x86
Oct 27 04:56:08 nomad[6207]: io.ReadFull(0x1fbaec0, 0xc420344540, 0xc4204f7810, 0xc, 0xc, 0xc, 0x0, 0x0)
Oct 27 04:56:08 nomad[6207]: #011/usr/local/go/src/io/io.go:327 +0x58
Oct 27 04:56:08 nomad[6207]: github.com/hashicorp/nomad/vendor/github.com/hashicorp/yamux.(*Session).recvLoop(0xc4207002c0, 0x0, 0x0)
Oct 27 04:56:08 nomad[6207]: #011/build/nomad-0.7.0/src/github.com/hashicorp/nomad/vendor/github.com/hashicorp/yamux/session.go:418 +0xfc
Oct 27 04:56:08 nomad[6207]: github.com/hashicorp/nomad/vendor/github.com/hashicorp/yamux.(*Session).recv(0xc4207002c0)
Oct 27 04:56:08 nomad[6207]: #011/build/nomad-0.7.0/src/github.com/hashicorp/nomad/vendor/github.com/hashicorp/yamux/session.go:406 +0x2b
Oct 27 04:56:08 nomad[6207]: created by github.com/hashicorp/nomad/vendor/github.com/hashicorp/yamux.newSession
Oct 27 04:56:08 nomad[6207]: #011/build/nomad-0.7.0/src/github.com/hashicorp/nomad/vendor/github.com/hashicorp/yamux/session.go:108 +0x3e4
Oct 27 04:56:08 nomad[6207]: goroutine 114 [select]:
Oct 27 04:56:08 nomad[6207]: github.com/hashicorp/nomad/client.(*Client).registerAndHeartbeat(0xc42025a160)
Oct 27 04:56:08 nomad[6207]: #011/build/nomad-0.7.0/src/github.com/hashicorp/nomad/client/client.go:1032 +0x19d
Oct 27 04:56:08 nomad[6207]: created by github.com/hashicorp/nomad/client.NewClient
Oct 27 04:56:08 nomad[6207]: #011/build/nomad-0.7.0/src/github.com/hashicorp/nomad/client/client.go:286 +0xcf0
Oct 27 04:56:08 nomad[6207]: goroutine 115 [select]:
Oct 27 04:56:08 nomad[6207]: github.com/hashicorp/nomad/client.(*Client).periodicSnapshot(0xc42025a160)
Oct 27 04:56:08 nomad[6207]: #011/build/nomad-0.7.0/src/github.com/hashicorp/nomad/client/client.go:1070 +0x103
Oct 27 04:56:08 nomad[6207]: created by github.com/hashicorp/nomad/client.NewClient
Oct 27 04:56:08 nomad[6207]: #011/build/nomad-0.7.0/src/github.com/hashicorp/nomad/client/client.go:289 +0xd12
Oct 27 04:56:08 nomad[6207]: goroutine 116 [select]:
Oct 27 04:56:08 nomad[6207]: github.com/hashicorp/nomad/client.(*Client).allocSync(0xc42025a160)
Oct 27 04:56:08 nomad[6207]: #011/build/nomad-0.7.0/src/github.com/hashicorp/nomad/client/client.go:1266 +0x209
Oct 27 04:56:08 nomad[6207]: created by github.com/hashicorp/nomad/client.NewClient
Oct 27 04:56:08 nomad[6207]: #011/build/nomad-0.7.0/src/github.com/hashicorp/nomad/client/client.go:292 +0xd34
Oct 27 04:56:08 nomad[6207]: goroutine 117 [select, 3 minutes]:
Oct 27 04:56:08 nomad[6207]: github.com/hashicorp/nomad/client.(*Client).run(0xc42025a160)
Oct 27 04:56:08 nomad[6207]: #011/build/nomad-0.7.0/src/github.com/hashicorp/nomad/client/client.go:1090 +0x153
Oct 27 04:56:08 nomad[6207]: created by github.com/hashicorp/nomad/client.NewClient
Oct 27 04:56:08 nomad[6207]: #011/build/nomad-0.7.0/src/github.com/hashicorp/nomad/client/client.go:295 +0xd56
Oct 27 04:56:08 nomad[6207]: goroutine 118 [runnable]:
Oct 27 04:56:08 nomad[6207]: syscall.Syscall6(0x101, 0xffffffffffffff9c, 0xc4201dbbd0, 0x80000, 0x0, 0x0, 0x0, 0x7, 0x80000, 0x0)
Oct 27 04:56:08 nomad[6207]: #011/usr/local/go/src/syscall/asm_linux_amd64.s:44 +0x5
Oct 27 04:56:08 nomad[6207]: syscall.openat(0xffffffffffffff9c, 0xc4201dbbc0, 0xa, 0x80000, 0xc400000000, 0x4492d7, 0x0, 0xc42061b848)
Oct 27 04:56:08 nomad[6207]: #011/usr/local/go/src/syscall/zsyscall_linux_amd64.go:38 +0xba
Oct 27 04:56:08 nomad[6207]: syscall.Open(0xc4201dbbc0, 0xa, 0x80000, 0xc400000000, 0xa, 0x158e41f, 0x5)
Oct 27 04:56:08 nomad[6207]: #011/usr/local/go/src/syscall/syscall_linux.go:51 +0x50
Oct 27 04:56:08 nomad[6207]: os.OpenFile(0xc4201dbbc0, 0xa, 0x0, 0x0, 0x1fbb680, 0xc42003a040, 0xc4201dbbc0)
Oct 27 04:56:08 nomad[6207]: #011/usr/local/go/src/os/file_unix.go:158 +0x7a
Oct 27 04:56:08 nomad[6207]: os.Open(0xc4201dbbc0, 0xa, 0xa, 0xc4201dbbc0, 0xa)
Oct 27 04:56:08 nomad[6207]: #011/usr/local/go/src/os/file.go:238 +0x46
Oct 27 04:56:08 nomad[6207]: github.com/hashicorp/nomad/vendor/github.com/shirou/gopsutil/internal/common.ReadLinesOffsetN(0xc4201dbbc0, 0xa, 0x0, 0xffffffffffffffff, 0x0, 0x0, 0x0, 0x0, 0x0)
Oct 27 04:56:08 nomad[6207]: #011/build/nomad-0.7.0/src/github.com/hashicorp/nomad/vendor/github.com/shirou/gopsutil/internal/common/common.go:101 +0x8c
Oct 27 04:56:08 nomad[6207]: github.com/hashicorp/nomad/vendor/github.com/shirou/gopsutil/internal/common.ReadLines(0xc4201dbbc0, 0xa, 0x1, 0xc4201dbbc0, 0xa, 0x18, 0x100)
Oct 27 04:56:08 nomad[6207]: #011/build/nomad-0.7.0/src/github.com/hashicorp/nomad/vendor/github.com/shirou/gopsutil/internal/common/common.go:92 +0x47
Oct 27 04:56:08 nomad[6207]: github.com/hashicorp/nomad/vendor/github.com/shirou/gopsutil/cpu.Times(0x4ab601, 0xc420800000, 0x7f05e6d3d000, 0x0, 0x3, 0x7)
Oct 27 04:56:08 nomad[6207]: #011/build/nomad-0.7.0/src/github.com/hashicorp/nomad/vendor/github.com/shirou/gopsutil/cpu/cpu_linux.go:36 +0x308
Oct 27 04:56:08 nomad[6207]: github.com/hashicorp/nomad/client/stats.(*HostStatsCollector).collectCPUStats(0xc42039a0f0, 0xc4209a3440, 0x0, 0x0, 0x2, 0x2, 0xc42061bfc0)
Oct 27 04:56:08 nomad[6207]: #011/build/nomad-0.7.0/src/github.com/hashicorp/nomad/client/stats/cpu_unix.go:13 +0x3b
Oct 27 04:56:08 nomad[6207]: github.com/hashicorp/nomad/client/stats.(*HostStatsCollector).Collect(0xc42039a0f0, 0x0, 0x0)
Oct 27 04:56:08 nomad[6207]: #011/build/nomad-0.7.0/src/github.com/hashicorp/nomad/client/stats/host.go:114 +0x225
Oct 27 04:56:08 nomad[6207]: github.com/hashicorp/nomad/client.(*Client).emitStats(0xc42025a160)
Oct 27 04:56:08 nomad[6207]: #011/build/nomad-0.7.0/src/github.com/hashicorp/nomad/client/client.go:1883 +0x25e
Oct 27 04:56:08 nomad[6207]: created by github.com/hashicorp/nomad/client.NewClient
Oct 27 04:56:08 nomad[6207]: #011/build/nomad-0.7.0/src/github.com/hashicorp/nomad/client/client.go:298 +0xd78
Oct 27 04:56:08 nomad[6207]: goroutine 119 [IO wait]:
Oct 27 04:56:08 nomad[6207]: internal/poll.runtime_pollWait(0x7f05e6ce1df0, 0x72, 0xffffffffffffffff)
Oct 27 04:56:08 nomad[6207]: #011/usr/local/go/src/runtime/netpoll.go:173 +0x57
Oct 27 04:56:08 nomad[6207]: internal/poll.(*pollDesc).wait(0xc420013b98, 0x72, 0xc4202e8d00, 0x0, 0x0)
Oct 27 04:56:08 nomad[6207]: #011/usr/local/go/src/internal/poll/fd_poll_runtime.go:85 +0xae
Oct 27 04:56:08 nomad[6207]: internal/poll.(*pollDesc).waitRead(0xc420013b98, 0xffffffffffffff00, 0x0, 0x0)
Oct 27 04:56:08 nomad[6207]: #011/usr/local/go/src/internal/poll/fd_poll_runtime.go:90 +0x3d
Oct 27 04:56:08 nomad[6207]: internal/poll.(*FD).Accept(0xc420013b80, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0)
Oct 27 04:56:08 nomad[6207]: #011/usr/local/go/src/internal/poll/fd_unix.go:334 +0x1e2
Oct 27 04:56:08 nomad[6207]: net.(*netFD).accept(0xc420013b80, 0xc4202e8e78, 0x4020c7, 0xc4201f3160)
Oct 27 04:56:08 nomad[6207]: #011/usr/local/go/src/net/fd_unix.go:238 +0x42
Oct 27 04:56:08 nomad[6207]: net.(*TCPListener).accept(0xc4201c4268, 0x70ec48, 0x45b570, 0xc4202e8ec0)
Oct 27 04:56:08 nomad[6207]: #011/usr/local/go/src/net/tcpsock_posix.go:136 +0x2e
Oct 27 04:56:08 nomad[6207]: net.(*TCPListener).Accept(0xc4201c4268, 0x15f9b88, 0xc4201f30e0, 0x1fcb280, 0xc420382480)
Oct 27 04:56:08 nomad[6207]: #011/usr/local/go/src/net/tcpsock.go:247 +0x49
Oct 27 04:56:08 nomad[6207]: net/http.(*Server).Serve(0xc42035c000, 0x1fc9600, 0xc4201c4268, 0x0, 0x0)
Oct 27 04:56:08 nomad[6207]: #011/usr/local/go/src/net/http/server.go:2695 +0x1b2
Oct 27 04:56:08 nomad[6207]: net/http.Serve(0x1fc9600, 0xc4201c4268, 0x1fbffc0, 0xc4203d1da0, 0x1fc9600, 0xc4201c4268)
Oct 27 04:56:08 nomad[6207]: #011/usr/local/go/src/net/http/server.go:2323 +0x73
Oct 27 04:56:08 nomad[6207]: created by github.com/hashicorp/nomad/command/agent.NewHTTPServer
Oct 27 04:56:08 nomad[6207]: #011/build/nomad-0.7.0/src/github.com/hashicorp/nomad/command/agent/http.go:111 +0x3ea
Oct 27 04:56:08 nomad[6207]: goroutine 120 [select, 936 minutes]:
Oct 27 04:56:08 nomad[6207]: github.com/hashicorp/nomad/vendor/github.com/hashicorp/go-checkpoint.CheckInterval.func1(0x4e94914f0000, 0xc420013c00, 0xc42031e300, 0xc4202b9620)
Oct 27 04:56:08 nomad[6207]: #011/build/nomad-0.7.0/src/github.com/hashicorp/nomad/vendor/github.com/hashicorp/go-checkpoint/checkpoint.go:314 +0x134
Oct 27 04:56:08 nomad[6207]: created by github.com/hashicorp/nomad/vendor/github.com/hashicorp/go-checkpoint.CheckInterval
Oct 27 04:56:08 nomad[6207]: #011/build/nomad-0.7.0/src/github.com/hashicorp/nomad/vendor/github.com/hashicorp/go-checkpoint/checkpoint.go:312 +0xbb
Oct 27 04:56:08 nomad[6207]: goroutine 664755 [semacquire, 1865 minutes]:
Oct 27 04:56:08 nomad[6207]: sync.runtime_notifyListWait(0xc4200eb6c0, 0xc400000001)
Oct 27 04:56:08 nomad[6207]: #011/usr/local/go/src/runtime/sema.go:507 +0x110
Oct 27 04:56:08 nomad[6207]: sync.(*Cond).Wait(0xc4200eb6b0)
Oct 27 04:56:08 nomad[6207]: #011/usr/local/go/src/sync/cond.go:56 +0x80
Oct 27 04:56:08 nomad[6207]: io.(*pipe).read(0xc4200eb680, 0xc420ab0000, 0x1000, 0x1000, 0x0, 0x0, 0x0)
Oct 27 04:56:08 nomad[6207]: #011/usr/local/go/src/io/pipe.go:47 +0xc6
Oct 27 04:56:08 nomad[6207]: io.(*PipeReader).Read(0xc4201c5238, 0xc420ab0000, 0x1000, 0x1000, 0x8c, 0x0, 0x0)
Oct 27 04:56:08 nomad[6207]: #011/usr/local/go/src/io/pipe.go:130 +0x4c
Oct 27 04:56:08 nomad[6207]: bufio.(*Reader).fill(0xc420038f60)
Oct 27 04:56:08 nomad[6207]: #011/usr/local/go/src/bufio/bufio.go:97 +0x11a
Oct 27 04:56:08 nomad[6207]: bufio.(*Reader).ReadSlice(0xc420038f60, 0xc42001c60a, 0xc420038d90, 0x4fe17e, 0xc42000e020, 0xc420038d90, 0x42cd36)
Oct 27 04:56:08 nomad[6207]: #011/usr/local/go/src/bufio/bufio.go:338 +0x2c
Oct 27 04:56:08 nomad[6207]: bufio.(*Reader).ReadBytes(0xc420038f60, 0xc01f0a, 0xc4207b1270, 0x2, 0xc420898580, 0xe, 0xc4209d1e00)
Oct 27 04:56:08 nomad[6207]: #011/usr/local/go/src/bufio/bufio.go:416 +0x6b
Oct 27 04:56:08 nomad[6207]: bufio.(*Reader).ReadString(0xc420038f60, 0xc42089850a, 0xe, 0xc4209d1e00, 0x4, 0x4)
Oct 27 04:56:08 nomad[6207]: #011/usr/local/go/src/bufio/bufio.go:456 +0x38
Oct 27 04:56:08 nomad[6207]: github.com/hashicorp/nomad/vendor/github.com/hashicorp/go-plugin.(*Client).logStderr(0xc4204415e0, 0x1fbd7c0, 0xc4201c5238)
Oct 27 04:56:08 nomad[6207]: #011/build/nomad-0.7.0/src/github.com/hashicorp/nomad/vendor/github.com/hashicorp/go-plugin/client.go:735 +0xab
Oct 27 04:56:08 nomad[6207]: created by github.com/hashicorp/nomad/vendor/github.com/hashicorp/go-plugin.(*Client).Start
Oct 27 04:56:08 nomad[6207]: #011/build/nomad-0.7.0/src/github.com/hashicorp/nomad/vendor/github.com/hashicorp/go-plugin/client.go:545 +0xd64
Oct 27 04:56:08 nomad[6207]: goroutine 663768 [select, 1872 minutes]:
Oct 27 04:56:08 nomad[6207]: github.com/hashicorp/nomad/vendor/github.com/hashicorp/yamux.(*Session).AcceptStream(0xc4201ff550, 0xc4203616f0, 0xc, 0x1)
Oct 27 04:56:08 nomad[6207]: #011/build/nomad-0.7.0/src/github.com/hashicorp/nomad/vendor/github.com/hashicorp/yamux/session.go:201 +0xf2
Oct 27 04:56:08 nomad[6207]: github.com/hashicorp/nomad/vendor/github.com/hashicorp/go-plugin.(*MuxBroker).Run(0xc42073df80)
Oct 27 04:56:08 nomad[6207]: #011/build/nomad-0.7.0/src/github.com/hashicorp/nomad/vendor/github.com/hashicorp/go-plugin/mux_broker.go:139 +0x33
Oct 27 04:56:08 nomad[6207]: created by github.com/hashicorp/nomad/vendor/github.com/hashicorp/go-plugin.NewRPCClient
Oct 27 04:56:08 nomad[6207]: #011/build/nomad-0.7.0/src/github.com/hashicorp/nomad/vendor/github.com/hashicorp/go-plugin/rpc_client.go:88 +0x22f
Oct 27 04:56:08 nomad[6207]: goroutine 664776 [select, 1865 minutes]:
Oct 27 04:56:08 nomad[6207]: github.com/hashicorp/nomad/vendor/github.com/hashicorp/yamux.(*Stream).Read(0xc4203d6ea0, 0xc420774000, 0x2000, 0x2000, 0x0, 0x0, 0x0)
Oct 27 04:56:08 nomad[6207]: #011/build/nomad-0.7.0/src/github.com/hashicorp/nomad/vendor/github.com/hashicorp/yamux/stream.go:125 +0x270
Oct 27 04:56:08 nomad[6207]: io/ioutil.devNull.ReadFrom(0x0, 0x1fbca80, 0xc4203d6ea0, 0x13bb780, 0xc420528601, 0x7f05e6cadcb8)
Oct 27 04:56:08 nomad[6207]: #011/usr/local/go/src/io/ioutil/ioutil.go:144 +0x92
Oct 27 04:56:08 nomad[6207]: io/ioutil.(*devNull).ReadFrom(0x2033530, 0x1fbca80, 0xc4203d6ea0, 0x7f05e6cadcb8, 0x2033530, 0xb70001)
Oct 27 04:56:08 nomad[6207]: #011<autogenerated>:1 +0x50
Oct 27 04:56:08 nomad[6207]: io.copyBuffer(0x1fbfe40, 0x2033530, 0x1fbca80, 0xc4203d6ea0, 0x0, 0x0, 0x0, 0x0, 0xc420528798, 0x63e02d)
Oct 27 04:56:08 nomad[6207]: #011/usr/local/go/src/io/io.go:386 +0x2bb
Oct 27 04:56:08 nomad[6207]: io.Copy(0x1fbfe40, 0x2033530, 0x1fbca80, 0xc4203d6ea0, 0x1c, 0xc4202b8300, 0xb4ec40)
Oct 27 04:56:08 nomad[6207]: #011/usr/local/go/src/io/io.go:362 +0x68
Oct 27 04:56:08 nomad[6207]: github.com/hashicorp/nomad/vendor/github.com/hashicorp/go-plugin.copyStream(0x1590bdf, 0x6, 0x1fbfe40, 0x2033530, 0x1fbca80, 0xc4203d6ea0)
Oct 27 04:56:08 nomad[6207]: #011/build/nomad-0.7.0/src/github.com/hashicorp/nomad/vendor/github.com/hashicorp/go-plugin/stream.go:15 +0x79
Oct 27 04:56:08 nomad[6207]: created by github.com/hashicorp/nomad/vendor/github.com/hashicorp/go-plugin.(*RPCClient).SyncStreams
Oct 27 04:56:08 nomad[6207]: #011/build/nomad-0.7.0/src/github.com/hashicorp/nomad/vendor/github.com/hashicorp/go-plugin/rpc_client.go:108 +0x9d
Oct 27 04:56:08 nomad[6207]: goroutine 663771 [select, 1872 minutes]:
Oct 27 04:56:08 nomad[6207]: github.com/hashicorp/nomad/vendor/github.com/hashicorp/yamux.(*Stream).Read(0xc4209f4a90, 0xc4208d6000, 0x2000, 0x2000, 0x0, 0x0, 0x0)
Oct 27 04:56:08 nomad[6207]: #011/build/nomad-0.7.0/src/github.com/hashicorp/nomad/vendor/github.com/hashicorp/yamux/stream.go:125 +0x270
Oct 27 04:56:08 nomad[6207]: io/ioutil.devNull.ReadFrom(0x0, 0x1fbca80, 0xc4209f4a90, 0x13bb780, 0xc420524f01, 0x7f05e6cadcb8)
Oct 27 04:56:08 nomad[6207]: #011/usr/local/go/src/io/ioutil/ioutil.go:144 +0x92
Oct 27 04:56:08 nomad[6207]: io/ioutil.(*devNull).ReadFrom(0x2033530, 0x1fbca80, 0xc4209f4a90, 0x7f05e6cadcb8, 0x2033530, 0x1)
Oct 27 04:56:08 nomad[6207]: #011<autogenerated>:1 +0x50
Oct 27 04:56:08 nomad[6207]: io.copyBuffer(0x1fbfe40, 0x2033530, 0x1fbca80, 0xc4209f4a90, 0x0, 0x0, 0x0, 0xc420524f38, 0x1, 0x527ef5)
Oct 27 04:56:08 nomad[6207]: #011/usr/local/go/src/io/io.go:386 +0x2bb
Oct 27 04:56:08 nomad[6207]: io.Copy(0x1fbfe40, 0x2033530, 0x1fbca80, 0xc4209f4a90, 0x1, 0x2, 0x7)
Oct 27 04:56:08 nomad[6207]: #011/usr/local/go/src/io/io.go:362 +0x68
Oct 27 04:56:08 nomad[6207]: github.com/hashicorp/nomad/vendor/github.com/hashicorp/go-plugin.copyStream(0x1590bd9, 0x6, 0x1fbfe40, 0x2033530, 0x1fbca80, 0xc4209f4a90)
Oct 27 04:56:08 nomad[6207]: #011/build/nomad-0.7.0/src/github.com/hashicorp/nomad/vendor/github.com/hashicorp/go-plugin/stream.go:15 +0x79
Oct 27 04:56:08 nomad[6207]: created by github.com/hashicorp/nomad/vendor/github.com/hashicorp/go-plugin.(*RPCClient).SyncStreams
Oct 27 04:56:08 nomad[6207]: #011/build/nomad-0.7.0/src/github.com/hashicorp/nomad/vendor/github.com/hashicorp/go-plugin/rpc_client.go:109 +0x119
Oct 27 04:56:08 nomad[6207]: goroutine 664225 [IO wait, 1869 minutes]:
Oct 27 04:56:08 nomad[6207]: internal/poll.runtime_pollWait(0x7f05e6ce12b0, 0x72, 0x1)
Oct 27 04:56:08 nomad[6207]: #011/usr/local/go/src/runtime/netpoll.go:173 +0x57
Oct 27 04:56:08 nomad[6207]: internal/poll.(*pollDesc).wait(0xc4205c4d88, 0x72, 0xffffffffffffff01, 0x1fc0ac0, 0x1fb92d8)
Oct 27 04:56:08 nomad[6207]: #011/usr/local/go/src/internal/poll/fd_poll_runtime.go:85 +0xae
Oct 27 04:56:08 nomad[6207]: internal/poll.(*pollDesc).waitRead(0xc4205c4d88, 0xc420b64001, 0x8000, 0x8000)
Oct 27 04:56:08 nomad[6207]: #011/usr/local/go/src/internal/poll/fd_poll_runtime.go:90 +0x3d
Oct 27 04:56:08 nomad[6207]: internal/poll.(*FD).Read(0xc4205c4d70, 0xc420b64000, 0x8000, 0x8000, 0x0, 0x0, 0x0)
Oct 27 04:56:08 nomad[6207]: #011/usr/local/go/src/internal/poll/fd_unix.go:125 +0x18a
Oct 27 04:56:08 nomad[6207]: os.(*File).read(0xc4201c4100, 0xc420b64000, 0x8000, 0x8000, 0xc4203cd660, 0x46adcc, 0xc4203ac180)
Oct 27 04:56:08 nomad[6207]: #011/usr/local/go/src/os/file_unix.go:216 +0x4e
Oct 27 04:56:08 nomad[6207]: os.(*File).Read(0xc4201c4100, 0xc420b64000, 0x8000, 0x8000, 0x25, 0x0, 0x0)
Oct 27 04:56:08 nomad[6207]: #011/usr/local/go/src/os/file.go:103 +0x6d
Oct 27 04:56:08 nomad[6207]: io.copyBuffer(0x1fbd800, 0xc4201c40b8, 0x1fbe480, 0xc4201c4100, 0xc420b64000, 0x8000, 0x8000, 0xc420141ef0, 0x1, 0x0)
Oct 27 04:56:08 nomad[6207]: #011/usr/local/go/src/io/io.go:392 +0x123
Oct 27 04:56:08 nomad[6207]: io.Copy(0x1fbd800, 0xc4201c40b8, 0x1fbe480, 0xc4201c4100, 0x0, 0x0, 0xc4205b3740)
Oct 27 04:56:08 nomad[6207]: #011/usr/local/go/src/io/io.go:362 +0x68
Oct 27 04:56:08 nomad[6207]: os/exec.(*Cmd).writerDescriptor.func1(0x45ee21, 0x200e9e0)
Oct 27 04:56:08 nomad[6207]: #011/usr/local/go/src/os/exec/exec.go:264 +0x4d
Oct 27 04:56:08 nomad[6207]: os/exec.(*Cmd).Start.func1(0xc4200f2580, 0xc4205e0ba0)
Oct 27 04:56:08 nomad[6207]: #011/usr/local/go/src/os/exec/exec.go:380 +0x27
Oct 27 04:56:08 nomad[6207]: created by os/exec.(*Cmd).Start
Oct 27 04:56:08 nomad[6207]: #011/usr/local/go/src/os/exec/exec.go:379 +0x646
Oct 27 04:56:08 nomad[6207]: goroutine 664738 [select, 1865 minutes]:
Oct 27 04:56:08 nomad[6207]: github.com/hashicorp/nomad/vendor/github.com/hashicorp/consul-template/manager.(*Runner).Start(0xc420991b00)
Oct 27 04:56:08 nomad[6207]: #011/build/nomad-0.7.0/src/github.com/hashicorp/nomad/vendor/github.com/hashicorp/consul-template/manager/runner.go:324 +0x999
Oct 27 04:56:08 nomad[6207]: created by github.com/hashicorp/nomad/client.(*TaskTemplateManager).run
Oct 27 04:56:08 nomad[6207]: #011/build/nomad-0.7.0/src/github.com/hashicorp/nomad/client/consul_template.go:203 +0x50
Oct 27 04:56:08 nomad[6207]: goroutine 664754 [syscall, 1865 minutes]:
Oct 27 04:56:08 nomad[6207]: syscall.Syscall6(0xf7, 0x1, 0x178a, 0xc4203e6578, 0x1000004, 0x0, 0x0, 0xc4207ef3c0, 0xc4203e67aa, 0xc4201ee5b0)
Oct 27 04:56:08 nomad[6207]: #011/usr/local/go/src/syscall/asm_linux_amd64.s:44 +0x5
Oct 27 04:56:08 nomad[6207]: os.(*Process).blockUntilWaitable(0xc420915530, 0xc4203e6668, 0x43e4bf, 0xc4203e6678)
Oct 27 04:56:08 nomad[6207]: #011/usr/local/go/src/os/wait_waitid.go:31 +0xa5
Oct 27 04:56:08 nomad[6207]: os.(*Process).wait(0xc420915530, 0x6, 0xc42024d500, 0xc4208ae6e0)
Oct 27 04:56:08 nomad[6207]: #011/usr/local/go/src/os/exec_unix.go:22 +0x42
Oct 27 04:56:08 nomad[6207]: os.(*Process).Wait(0xc420915530, 0x0, 0x0, 0x0)
Oct 27 04:56:08 nomad[6207]: #011/usr/local/go/src/os/exec.go:115 +0x2b
Oct 27 04:56:08 nomad[6207]: os/exec.(*Cmd).Wait(0xc4202c9340, 0x15f9950, 0xc4201c5230)
Oct 27 04:56:08 nomad[6207]: #011/usr/local/go/src/os/exec/exec.go:446 +0x62
Oct 27 04:56:08 nomad[6207]: github.com/hashicorp/nomad/vendor/github.com/hashicorp/go-plugin.(*Client).Start.func3(0xc4201c5240, 0xc4201c5230, 0xc4202c9340, 0xc4204415e0, 0xc420a96360)
Oct 27 04:56:08 nomad[6207]: #011/build/nomad-0.7.0/src/github.com/hashicorp/nomad/vendor/github.com/hashicorp/go-plugin/client.go:529 +0x83
Oct 27 04:56:08 nomad[6207]: created by github.com/hashicorp/nomad/vendor/github.com/hashicorp/go-plugin.(*Client).Start
Oct 27 04:56:08 nomad[6207]: #011/build/nomad-0.7.0/src/github.com/hashicorp/nomad/vendor/github.com/hashicorp/go-plugin/client.go:522 +0xd26
Oct 27 04:56:08 nomad[6207]: goroutine 664276 [semacquire, 1869 minutes]:
Oct 27 04:56:08 nomad[6207]: sync.runtime_notifyListWait(0xc4203ac4c0, 0xc400000001)
Oct 27 04:56:08 nomad[6207]: #011/usr/local/go/src/runtime/sema.go:507 +0x110
Oct 27 04:56:08 nomad[6207]: sync.(*Cond).Wait(0xc4203ac4b0)
Oct 27 04:56:08 nomad[6207]: #011/usr/local/go/src/sync/cond.go:56 +0x80
Oct 27 04:56:08 nomad[6207]: io.(*pipe).read(0xc4203ac480, 0xc4205a5000, 0x1000, 0x1000, 0x0, 0x0, 0x0)
Oct 27 04:56:08 nomad[6207]: #011/usr/local/go/src/io/pipe.go:47 +0xc6
Oct 27 04:56:08 nomad[6207]: io.(*PipeReader).Read(0xc4201c40c8, 0xc4205a5000, 0x1000, 0x1000, 0x8c, 0x0, 0x0)
Oct 27 04:56:08 nomad[6207]: #011/usr/local/go/src/io/pipe.go:130 +0x4c
Oct 27 04:56:08 nomad[6207]: bufio.(*Reader).fill(0xc4208d9f60)
Oct 27 04:56:08 nomad[6207]: #011/usr/local/go/src/bufio/bufio.go:97 +0x11a
Oct 27 04:56:08 nomad[6207]: bufio.(*Reader).ReadSlice(0xc4208d9f60, 0xc42001a00a, 0xc4208d9d90, 0x4fe17e, 0xc42000e020, 0xc4208d9d90, 0x42cd36)
Oct 27 04:56:08 nomad[6207]: #011/usr/local/go/src/bufio/bufio.go:338 +0x2c
Oct 27 04:56:08 nomad[6207]: bufio.(*Reader).ReadBytes(0xc4208d9f60, 0xc01f0a, 0xc4201bf3b0, 0x2, 0xc420014b00, 0xe, 0xc420836f00)
Oct 27 04:56:08 nomad[6207]: #011/usr/local/go/src/bufio/bufio.go:416 +0x6b
Oct 27 04:56:08 nomad[6207]: bufio.(*Reader).ReadString(0xc4208d9f60, 0xc420014b0a, 0xe, 0xc420836f00, 0x4, 0x4)
Oct 27 04:56:08 nomad[6207]: #011/usr/local/go/src/bufio/bufio.go:456 +0x38
Oct 27 04:56:08 nomad[6207]: github.com/hashicorp/nomad/vendor/github.com/hashicorp/go-plugin.(*Client).logStderr(0xc4204782a0, 0x1fbd7c0, 0xc4201c40c8)
Oct 27 04:56:08 nomad[6207]: #011/build/nomad-0.7.0/src/github.com/hashicorp/nomad/vendor/github.com/hashicorp/go-plugin/client.go:735 +0xab
Oct 27 04:56:08 nomad[6207]: created by github.com/hashicorp/nomad/vendor/github.com/hashicorp/go-plugin.(*Client).Start
Oct 27 04:56:08 nomad[6207]: #011/build/nomad-0.7.0/src/github.com/hashicorp/nomad/vendor/github.com/hashicorp/go-plugin/client.go:545 +0xd64
Oct 27 04:56:08 nomad[6207]: goroutine 664278 [chan receive, 1869 minutes]:
Oct 27 04:56:08 nomad[6207]: github.com/hashicorp/nomad/vendor/github.com/hashicorp/go-plugin.(*Client).Start.func5.1(0xc4202b93e0)
Oct 27 04:56:08 nomad[6207]: #011/build/nomad-0.7.0/src/github.com/hashicorp/nomad/vendor/github.com/hashicorp/go-plugin/client.go:570 +0x6d
Oct 27 04:56:08 nomad[6207]: created by github.com/hashicorp/nomad/vendor/github.com/hashicorp/go-plugin.(*Client).Start.func5
Oct 27 04:56:08 nomad[6207]: #011/build/nomad-0.7.0/src/github.com/hashicorp/nomad/vendor/github.com/hashicorp/go-plugin/client.go:569 +0x3f
Oct 27 04:56:08 nomad[6207]: goroutine 664777 [select, 1865 minutes]:
Oct 27 04:56:08 nomad[6207]: github.com/hashicorp/nomad/vendor/github.com/hashicorp/yamux.(*Stream).Read(0xc4203d6f70, 0xc420776000, 0x2000, 0x2000, 0x0, 0x0, 0x0)
Oct 27 04:56:08 nomad[6207]: #011/build/nomad-0.7.0/src/github.com/hashicorp/nomad/vendor/github.com/hashicorp/yamux/stream.go:125 +0x270
Oct 27 04:56:08 nomad[6207]: io/ioutil.devNull.ReadFrom(0x0, 0x1fbca80, 0xc4203d6f70, 0x13bb780, 0xaffd01, 0x7f05e6cadcb8)
Oct 27 04:56:08 nomad[6207]: #011/usr/local/go/src/io/ioutil/ioutil.go:144 +0x92
Oct 27 04:56:08 nomad[6207]: io/ioutil.(*devNull).ReadFrom(0x2033530, 0x1fbca80, 0xc4203d6f70, 0x7f05e6cadcb8, 0x2033530, 0xc42017c001)
Oct 27 04:56:08 nomad[6207]: #011<autogenerated>:1 +0x50
Oct 27 04:56:08 nomad[6207]: io.copyBuffer(0x1fbfe40, 0x2033530, 0x1fbca80, 0xc4203d6f70, 0x0, 0x0, 0x0, 0xc4201eb520, 0x15d642d, 0x3b)
Oct 27 04:56:08 nomad[6207]: #011/usr/local/go/src/io/io.go:386 +0x2bb
Oct 27 04:56:08 nomad[6207]: io.Copy(0x1fbfe40, 0x2033530, 0x1fbca80, 0xc4203d6f70, 0xb0bda0, 0xc42017c040, 0xc4203e46b8)
Oct 27 04:56:08 nomad[6207]: #011/usr/local/go/src/io/io.go:362 +0x68
Oct 27 04:56:08 nomad[6207]: github.com/hashicorp/nomad/vendor/github.com/hashicorp/go-plugin.copyStream(0x1590bd9, 0x6, 0x1fbfe40, 0x2033530, 0x1fbca80, 0xc4203d6f70)
Oct 27 04:56:08 nomad[6207]: #011/build/nomad-0.7.0/src/github.com/hashicorp/nomad/vendor/github.com/hashicorp/go-plugin/stream.go:15 +0x79
Oct 27 04:56:08 nomad[6207]: created by github.com/hashicorp/nomad/vendor/github.com/hashicorp/go-plugin.(*RPCClient).SyncStreams
Oct 27 04:56:08 nomad[6207]: #011/build/nomad-0.7.0/src/github.com/hashicorp/nomad/vendor/github.com/hashicorp/go-plugin/rpc_client.go:109 +0x119
Oct 27 04:56:08 nomad[6207]: goroutine 664249 [select, 1869 minutes]:
Oct 27 04:56:08 nomad[6207]: github.com/hashicorp/nomad/vendor/github.com/hashicorp/consul-template/manager.(*Runner).Start(0xc42029f8c0)
Oct 27 04:56:08 nomad[6207]: #011/build/nomad-0.7.0/src/github.com/hashicorp/nomad/vendor/github.com/hashicorp/consul-template/manager/runner.go:324 +0x999
Oct 27 04:56:08 nomad[6207]: created by github.com/hashicorp/nomad/client.(*TaskTemplateManager).run
Oct 27 04:56:08 nomad[6207]: #011/build/nomad-0.7.0/src/github.com/hashicorp/nomad/client/consul_template.go:203 +0x50
Oct 27 04:56:08 nomad[6207]: goroutine 663724 [select, 1872 minutes]:
Oct 27 04:56:08 nomad[6207]: github.com/hashicorp/nomad/vendor/github.com/hashicorp/consul-template/watch.(*View).poll(0xc420b38d80, 0xc4201716e0, 0xc4207a6de0)
Oct 27 04:56:08 nomad[6207]: #011/build/nomad-0.7.0/src/github.com/hashicorp/nomad/vendor/github.com/hashicorp/consul-template/watch/view.go:128 +0x1e8
Oct 27 04:56:08 nomad[6207]: created by github.com/hashicorp/nomad/vendor/github.com/hashicorp/consul-template/watch.(*Watcher).Add
Oct 27 04:56:08 nomad[6207]: #011/build/nomad-0.7.0/src/github.com/hashicorp/nomad/vendor/github.com/hashicorp/consul-template/watch/watcher.go:164 +0x48b
Oct 27 04:56:08 nomad[6207]: goroutine 663781 [syscall, 1872 minutes]:
Oct 27 04:56:08 nomad[6207]: syscall.Syscall6(0xf7, 0x1, 0x1472, 0xc420027578, 0x1000004, 0x0, 0x0, 0x0, 0x0, 0x0)
Oct 27 04:56:08 nomad[6207]: #011/usr/local/go/src/syscall/asm_linux_amd64.s:44 +0x5
Oct 27 04:56:08 nomad[6207]: os.(*Process).blockUntilWaitable(0xc4200193e0, 0xc4206422a0, 0xc4202fb690, 0xe)
Oct 27 04:56:08 nomad[6207]: #011/usr/local/go/src/os/wait_waitid.go:31 +0xa5
Oct 27 04:56:08 nomad[6207]: os.(*Process).wait(0xc4200193e0, 0x6, 0xc420816d80, 0xc420495c20)
Oct 27 04:56:08 nomad[6207]: #011/usr/local/go/src/os/exec_unix.go:22 +0x42
Oct 27 04:56:08 nomad[6207]: os.(*Process).Wait(0xc4200193e0, 0x63e02d, 0x200e9e0, 0x1fcb240)
Oct 27 04:56:08 nomad[6207]: #011/usr/local/go/src/os/exec.go:115 +0x2b
Oct 27 04:56:08 nomad[6207]: os/exec.(*Cmd).Wait(0xc420078840, 0x15f9950, 0xc4201c4358)
Oct 27 04:56:08 nomad[6207]: #011/usr/local/go/src/os/exec/exec.go:446 +0x62
Oct 27 04:56:08 nomad[6207]: github.com/hashicorp/nomad/vendor/github.com/hashicorp/go-plugin.(*Client).Start.func3(0xc4201c4378, 0xc4201c4358, 0xc420078840, 0xc4202ec150, 0xc42014c4e0)
Oct 27 04:56:08 nomad[6207]: #011/build/nomad-0.7.0/src/github.com/hashicorp/nomad/vendor/github.com/hashicorp/go-plugin/client.go:529 +0x83
Oct 27 04:56:08 nomad[6207]: created by github.com/hashicorp/nomad/vendor/github.com/hashicorp/go-plugin.(*Client).Start
Oct 27 04:56:08 nomad[6207]: #011/build/nomad-0.7.0/src/github.com/hashicorp/nomad/vendor/github.com/hashicorp/go-plugin/client.go:522 +0xd26
Oct 27 04:56:08 nomad[6207]: goroutine 664143 [select, 1869 minutes]:
Oct 27 04:56:08 nomad[6207]: github.com/hashicorp/nomad/client.(*AllocRunner).Run(0xc4209a4c60)
Oct 27 04:56:08 nomad[6207]: #011/build/nomad-0.7.0/src/github.com/hashicorp/nomad/client/alloc_runner.go:823 +0xa7c
Oct 27 04:56:08 nomad[6207]: created by github.com/hashicorp/nomad/client.(*Client).addAlloc
Oct 27 04:56:08 nomad[6207]: #011/build/nomad-0.7.0/src/github.com/hashicorp/nomad/client/client.go:1629 +0x48c
Oct 27 04:56:08 nomad[6207]: goroutine 664773 [select]:
Oct 27 04:56:08 nomad[6207]: github.com/hashicorp/nomad/vendor/github.com/hashicorp/yamux.(*Session).keepalive(0xc420b88f20)
Oct 27 04:56:08 nomad[6207]: #011/build/nomad-0.7.0/src/github.com/hashicorp/nomad/vendor/github.com/hashicorp/yamux/session.go:302 +0x102
Oct 27 04:56:08 nomad[6207]: created by github.com/hashicorp/nomad/vendor/github.com/hashicorp/yamux.newSession
Oct 27 04:56:08 nomad[6207]: #011/build/nomad-0.7.0/src/github.com/hashicorp/nomad/vendor/github.com/hashicorp/yamux/session.go:111 +0x455
Oct 27 04:56:08 nomad[6207]: goroutine 664774 [select, 1865 minutes]:
Oct 27 04:56:08 nomad[6207]: github.com/hashicorp/nomad/vendor/github.com/hashicorp/yamux.(*Session).AcceptStream(0xc420b88f20, 0x20000, 0xc4205297c0, 0xc7e3bd)
Oct 27 04:56:08 nomad[6207]: #011/build/nomad-0.7.0/src/github.com/hashicorp/nomad/vendor/github.com/hashicorp/yamux/session.go:201 +0xf2
Oct 27 04:56:08 nomad[6207]: github.com/hashicorp/nomad/vendor/github.com/hashicorp/go-plugin.(*MuxBroker).Run(0xc42035f240)
Oct 27 04:56:08 nomad[6207]: #011/build/nomad-0.7.0/src/github.com/hashicorp/nomad/vendor/github.com/hashicorp/go-plugin/mux_broker.go:139 +0x33
Oct 27 04:56:08 nomad[6207]: created by github.com/hashicorp/nomad/vendor/github.com/hashicorp/go-plugin.NewRPCClient
Oct 27 04:56:08 nomad[6207]: #011/build/nomad-0.7.0/src/github.com/hashicorp/nomad/vendor/github.com/hashicorp/go-plugin/rpc_client.go:88 +0x22f
Oct 27 04:56:08 nomad[6207]: goroutine 664280 [select]:
Oct 27 04:56:08 nomad[6207]: github.com/hashicorp/nomad/vendor/github.com/hashicorp/yamux.(*Session).send(0xc420b88420)
Oct 27 04:56:08 nomad[6207]: #011/build/nomad-0.7.0/src/github.com/hashicorp/nomad/vendor/github.com/hashicorp/yamux/session.go:368 +0x2ca
Oct 27 04:56:08 nomad[6207]: created by github.com/hashicorp/nomad/vendor/github.com/hashicorp/yamux.newSession
Oct 27 04:56:08 nomad[6207]: #011/build/nomad-0.7.0/src/github.com/hashicorp/nomad/vendor/github.com/hashicorp/yamux/session.go:109 +0x406
Oct 27 04:56:08 nomad[6207]: goroutine 663722 [select, 1872 minutes]:
Oct 27 04:56:08 nomad[6207]: github.com/hashicorp/nomad/vendor/github.com/hashicorp/consul-template/watch.(*View).poll(0xc420b38c80, 0xc4201716e0, 0xc4207a6de0)
Oct 27 04:56:08 nomad[6207]: #011/build/nomad-0.7.0/src/github.com/hashicorp/nomad/vendor/github.com/hashicorp/consul-template/watch/view.go:128 +0x1e8
Oct 27 04:56:08 nomad[6207]: created by github.com/hashicorp/nomad/vendor/github.com/hashicorp/consul-template/watch.(*Watcher).Add
Oct 27 04:56:08 nomad[6207]: #011/build/nomad-0.7.0/src/github.com/hashicorp/nomad/vendor/github.com/hashicorp/consul-template/watch/watcher.go:164 +0x48b
Oct 27 04:56:08 nomad[6207]: goroutine 664718 [select, 1865 minutes]:
Oct 27 04:56:08 nomad[6207]: github.com/hashicorp/nomad/vendor/github.com/hashicorp/consul-template/dependency.(*VaultReadQuery).Fetch(0xc42030b800, 0xc42030aba0, 0xc42013c5a0, 0x0, 0x0, 0x0, 0x0, 0x0)
Oct 27 04:56:08 nomad[6207]: #011/build/nomad-0.7.0/src/github.com/hashicorp/nomad/vendor/github.com/hashicorp/consul-template/dependency/vault_read.go:89 +0xacb
Oct 27 04:56:08 nomad[6207]: github.com/hashicorp/nomad/vendor/github.com/hashicorp/consul-template/watch.(*View).fetch(0xc4205d3380, 0xc4207efbc0, 0xc4207efc20, 0xc42067faa0)
Oct 27 04:56:08 nomad[6207]: #011/build/nomad-0.7.0/src/github.com/hashicorp/nomad/vendor/github.com/hashicorp/consul-template/watch/view.go:210 +0x147
Oct 27 04:56:08 nomad[6207]: created by github.com/hashicorp/nomad/vendor/github.com/hashicorp/consul-template/watch.(*View).poll
Oct 27 04:56:08 nomad[6207]: #011/build/nomad-0.7.0/src/github.com/hashicorp/nomad/vendor/github.com/hashicorp/consul-template/watch/view.go:125 +0x516
Oct 27 04:56:08 nomad[6207]: goroutine 664274 [IO wait, 1869 minutes]:
Oct 27 04:56:08 nomad[6207]: internal/poll.runtime_pollWait(0x7f05e6ce17f0, 0x72, 0x1)
Oct 27 04:56:08 nomad[6207]: #011/usr/local/go/src/runtime/netpoll.go:173 +0x57
Oct 27 04:56:08 nomad[6207]: internal/poll.(*pollDesc).wait(0xc4205c4e78, 0x72, 0xffffffffffffff01, 0x1fc0ac0, 0x1fb92d8)
Oct 27 04:56:08 nomad[6207]: #011/usr/local/go/src/internal/poll/fd_poll_runtime.go:85 +0xae
Oct 27 04:56:08 nomad[6207]: internal/poll.(*pollDesc).waitRead(0xc4205c4e78, 0xc420b46001, 0x8000, 0x8000)
Oct 27 04:56:08 nomad[6207]: #011/usr/local/go/src/internal/poll/fd_poll_runtime.go:90 +0x3d
Oct 27 04:56:08 nomad[6207]: internal/poll.(*FD).Read(0xc4205c4e60, 0xc420b46000, 0x8000, 0x8000, 0x0, 0x0, 0x0)
Oct 27 04:56:08 nomad[6207]: #011/usr/local/go/src/internal/poll/fd_unix.go:125 +0x18a
Oct 27 04:56:08 nomad[6207]: os.(*File).read(0xc4201c4138, 0xc420b46000, 0x8000, 0x8000, 0xc420525e60, 0x46adcc, 0xc4203ac480)
Oct 27 04:56:08 nomad[6207]: #011/usr/local/go/src/os/file_unix.go:216 +0x4e
Oct 27 04:56:08 nomad[6207]: os.(*File).Read(0xc4201c4138, 0xc420b46000, 0x8000, 0x8000, 0x8c, 0x0, 0x0)
Oct 27 04:56:08 nomad[6207]: #011/usr/local/go/src/os/file.go:103 +0x6d
Oct 27 04:56:08 nomad[6207]: io.copyBuffer(0x1fbd800, 0xc4201c40e0, 0x1fbe480, 0xc4201c4138, 0xc420b46000, 0x8000, 0x8000, 0x0, 0x0, 0x0)
Oct 27 04:56:08 nomad[6207]: #011/usr/local/go/src/io/io.go:392 +0x123
Oct 27 04:56:08 nomad[6207]: io.Copy(0x1fbd800, 0xc4201c40e0, 0x1fbe480, 0xc4201c4138, 0x1, 0x0, 0x0)
Oct 27 04:56:08 nomad[6207]: #011/usr/local/go/src/io/io.go:362 +0x68
Oct 27 04:56:08 nomad[6207]: os/exec.(*Cmd).writerDescriptor.func1(0x435848, 0x15fa0f8)
Oct 27 04:56:08 nomad[6207]: #011/usr/local/go/src/os/exec/exec.go:264 +0x4d
Oct 27 04:56:08 nomad[6207]: os/exec.(*Cmd).Start.func1(0xc4200f2580, 0xc4205e0c00)
Oct 27 04:56:08 nomad[6207]: #011/usr/local/go/src/os/exec/exec.go:380 +0x27
Oct 27 04:56:08 nomad[6207]: created by os/exec.(*Cmd).Start
Oct 27 04:56:08 nomad[6207]: #011/usr/local/go/src/os/exec/exec.go:379 +0x646
Oct 27 04:56:08 nomad[6207]: goroutine 664654 [select, 1865 minutes]:
Oct 27 04:56:08 nomad[6207]: github.com/hashicorp/nomad/client.(*AllocRunner).dirtySyncState(0xc42025bce0)
Oct 27 04:56:08 nomad[6207]: #011/build/nomad-0.7.0/src/github.com/hashicorp/nomad/client/alloc_runner.go:576 +0xfe
Oct 27 04:56:08 nomad[6207]: created by github.com/hashicorp/nomad/client.(*AllocRunner).Run
Oct 27 04:56:08 nomad[6207]: #011/build/nomad-0.7.0/src/github.com/hashicorp/nomad/client/alloc_runner.go:736 +0x8b
Oct 27 04:56:08 nomad[6207]: goroutine 663723 [select, 1872 minutes]:
Oct 27 04:56:08 nomad[6207]: github.com/hashicorp/nomad/vendor/github.com/hashicorp/consul-template/watch.(*View).poll(0xc420b38d00, 0xc4201716e0, 0xc4207a6de0)
Oct 27 04:56:08 nomad[6207]: #011/build/nomad-0.7.0/src/github.com/hashicorp/nomad/vendor/github.com/hashicorp/consul-template/watch/view.go:128 +0x1e8
Oct 27 04:56:08 nomad[6207]: created by github.com/hashicorp/nomad/vendor/github.com/hashicorp/consul-template/watch.(*Watcher).Add
Oct 27 04:56:08 nomad[6207]: #011/build/nomad-0.7.0/src/github.com/hashicorp/nomad/vendor/github.com/hashicorp/consul-template/watch/watcher.go:164 +0x48b
Oct 27 04:56:08 nomad[6207]: goroutine 664285 [select, 1869 minutes]:
Oct 27 04:56:08 nomad[6207]: github.com/hashicorp/nomad/vendor/github.com/hashicorp/yamux.(*Stream).Read(0xc420518dd0, 0xc420664000, 0x2000, 0x2000, 0x0, 0x0, 0x0)
Oct 27 04:56:08 nomad[6207]: #011/build/nomad-0.7.0/src/github.com/hashicorp/nomad/vendor/github.com/hashicorp/yamux/stream.go:125 +0x270
Oct 27 04:56:08 nomad[6207]: io/ioutil.devNull.ReadFrom(0x0, 0x1fbca80, 0xc420518dd0, 0x13bb780, 0xc42004ae01, 0x7f05e6cadcb8)
Oct 27 04:56:08 nomad[6207]: #011/usr/local/go/src/io/ioutil/ioutil.go:144 +0x92
Oct 27 04:56:08 nomad[6207]: io/ioutil.(*devNull).ReadFrom(0x2033530, 0x1fbca80, 0xc420518dd0, 0x7f05e6cadcb8, 0x2033530, 0xc420b40001)
Oct 27 04:56:08 nomad[6207]: #011<autogenerated>:1 +0x50
Oct 27 04:56:08 nomad[6207]: io.copyBuffer(0x1fbfe40, 0x2033530, 0x1fbca80, 0xc420518dd0, 0x0, 0x0, 0x0, 0xc42001ae00, 0xc42004af98, 0x63e02d)
Oct 27 04:56:08 nomad[6207]: #011/usr/local/go/src/io/io.go:386 +0x2bb
Oct 27 04:56:08 nomad[6207]: io.Copy(0x1fbfe40, 0x2033530, 0x1fbca80, 0xc420518dd0, 0x42001c, 0xc42004af30, 0x45aea0)
Oct 27 04:56:08 nomad[6207]: #011/usr/local/go/src/io/io.go:362 +0x68
Oct 27 04:56:08 nomad[6207]: github.com/hashicorp/nomad/vendor/github.com/hashicorp/go-plugin.copyStream(0x1590bd9, 0x6, 0x1fbfe40, 0x2033530, 0x1fbca80, 0xc420518dd0)
Oct 27 04:56:08 nomad[6207]: #011/build/nomad-0.7.0/src/github.com/hashicorp/nomad/vendor/github.com/hashicorp/go-plugin/stream.go:15 +0x79
Oct 27 04:56:08 nomad[6207]: created by github.com/hashicorp/nomad/vendor/github.com/hashicorp/go-plugin.(*RPCClient).SyncStreams
Oct 27 04:56:08 nomad[6207]: #011/build/nomad-0.7.0/src/github.com/hashicorp/nomad/vendor/github.com/hashicorp/go-plugin/rpc_client.go:109 +0x119
Oct 27 04:56:08 nomad[6207]: goroutine 663797 [select]:
Oct 27 04:56:08 nomad[6207]: github.com/hashicorp/nomad/client.(*TaskRunner).collectResourceUsageStats(0xc420840ea0, 0xc420703020)
Oct 27 04:56:08 nomad[6207]: #011/build/nomad-0.7.0/src/github.com/hashicorp/nomad/client/task_runner.go:1556 +0x129
Oct 27 04:56:08 nomad[6207]: created by github.com/hashicorp/nomad/client.(*TaskRunner).run
Oct 27 04:56:08 nomad[6207]: #011/build/nomad-0.7.0/src/github.com/hashicorp/nomad/client/task_runner.go:1126 +0x15de
Oct 27 04:56:08 nomad[6207]: goroutine 663780 [IO wait, 1872 minutes]:
Oct 27 04:56:08 nomad[6207]: internal/poll.runtime_pollWait(0x7f05e6ce1730, 0x72, 0x1)
Oct 27 04:56:08 nomad[6207]: #011/usr/local/go/src/runtime/netpoll.go:173 +0x57
Oct 27 04:56:08 nomad[6207]: internal/poll.(*pollDesc).wait(0xc4208b4568, 0x72, 0xffffffffffffff01, 0x1fc0ac0, 0x1fb92d8)
Oct 27 04:56:08 nomad[6207]: #011/usr/local/go/src/internal/poll/fd_poll_runtime.go:85 +0xae
Oct 27 04:56:08 nomad[6207]: internal/poll.(*pollDesc).waitRead(0xc4208b4568, 0xc420728001, 0x8000, 0x8000)
Oct 27 04:56:08 nomad[6207]: #011/usr/local/go/src/internal/poll/fd_poll_runtime.go:90 +0x3d
Oct 27 04:56:08 nomad[6207]: internal/poll.(*FD).Read(0xc4208b4550, 0xc420728000, 0x8000, 0x8000, 0x0, 0x0, 0x0)
Oct 27 04:56:08 nomad[6207]: #011/usr/local/go/src/internal/poll/fd_unix.go:125 +0x18a
Oct 27 04:56:08 nomad[6207]: os.(*File).read(0xc4201c4418, 0xc420728000, 0x8000, 0x8000, 0xc420023e60, 0x46adcc, 0xc4200eb380)
Oct 27 04:56:08 nomad[6207]: #011/usr/local/go/src/os/file_unix.go:216 +0x4e
Oct 27 04:56:08 nomad[6207]: os.(*File).Read(0xc4201c4418, 0xc420728000, 0x8000, 0x8000, 0x8c, 0x0, 0x0)
Oct 27 04:56:08 nomad[6207]: #011/usr/local/go/src/os/file.go:103 +0x6d
Oct 27 04:56:08 nomad[6207]: io.copyBuffer(0x1fbd800, 0xc4201c4378, 0x1fbe480, 0xc4201c4418, 0xc420728000, 0x8000, 0x8000, 0xc42068ed70, 0xb0bda0, 0x71d287)
Oct 27 04:56:08 nomad[6207]: #011/usr/local/go/src/io/io.go:392 +0x123
Oct 27 04:56:08 nomad[6207]: io.Copy(0x1fbd800, 0xc4201c4378, 0x1fbe480, 0xc4201c4418, 0x4, 0xc42034c4d0, 0xe)
Oct 27 04:56:08 nomad[6207]: #011/usr/local/go/src/io/io.go:362 +0x68
Oct 27 04:56:08 nomad[6207]: os/exec.(*Cmd).writerDescriptor.func1(0xc420023fa8, 0x0)
Oct 27 04:56:08 nomad[6207]: #011/usr/local/go/src/os/exec/exec.go:264 +0x4d
Oct 27 04:56:08 nomad[6207]: os/exec.(*Cmd).Start.func1(0xc420078840, 0xc42036d280)
Oct 27 04:56:08 nomad[6207]: #011/usr/local/go/src/os/exec/exec.go:380 +0x27
Oct 27 04:56:08 nomad[6207]: created by os/exec.(*Cmd).Start
Oct 27 04:56:08 nomad[6207]: #011/usr/local/go/src/os/exec/exec.go:379 +0x646
Oct 27 04:56:08 nomad[6207]: goroutine 664778 [select]:
Oct 27 04:56:08 nomad[6207]: github.com/hashicorp/nomad/vendor/github.com/hashicorp/yamux.(*Stream).Read(0xc420ac60d0, 0xc420aca000, 0x1000, 0x1000, 0x0, 0x0, 0x0)
Oct 27 04:56:08 nomad[6207]: #011/build/nomad-0.7.0/src/github.com/hashicorp/nomad/vendor/github.com/hashicorp/yamux/stream.go:125 +0x270
Oct 27 04:56:08 nomad[6207]: bufio.(*Reader).Read(0xc420171380, 0xc420898680, 0x1, 0x9, 0xc420533ca8, 0x42ca58, 0x15f6080)
Oct 27 04:56:08 nomad[6207]: #011/usr/local/go/src/bufio/bufio.go:213 +0x30b
Oct 27 04:56:08 nomad[6207]: io.ReadAtLeast(0x1fbaec0, 0xc420171380, 0xc420898680, 0x1, 0x9, 0x1, 0xc42001b300, 0xc42092fcd0, 0x195)
Oct 27 04:56:08 nomad[6207]: #011/usr/local/go/src/io/io.go:309 +0x86
Oct 27 04:56:08 nomad[6207]: io.ReadFull(0x1fbaec0, 0xc420171380, 0xc420898680, 0x1, 0x9, 0xc420533d10, 0x40629b, 0x3)
Oct 27 04:56:08 nomad[6207]: #011/usr/local/go/src/io/io.go:327 +0x58
Oct 27 04:56:08 nomad[6207]: encoding/gob.decodeUintReader(0x1fbaec0, 0xc420171380, 0xc420898680, 0x9, 0x9, 0xc420533d88, 0x42c399, 0xc400000008, 0xc420b44700)
Oct 27 04:56:08 nomad[6207]: #011/usr/local/go/src/encoding/gob/decode.go:120 +0x63
Oct 27 04:56:08 nomad[6207]: encoding/gob.(*Decoder).recvMessage(0xc420662600, 0xc420533da0)
Oct 27 04:56:08 nomad[6207]: #011/usr/local/go/src/encoding/gob/decoder.go:80 +0x57
Oct 27 04:56:08 nomad[6207]: encoding/gob.(*Decoder).decodeTypeSequence(0xc420662600, 0x15fa300, 0xc420662600)
Oct 27 04:56:08 nomad[6207]: #011/usr/local/go/src/encoding/gob/decoder.go:144 +0x14c
Oct 27 04:56:08 nomad[6207]: encoding/gob.(*Decoder).DecodeValue(0xc420662600, 0x12cde80, 0xc420ace000, 0x16, 0x0, 0x0)
Oct 27 04:56:08 nomad[6207]: #011/usr/local/go/src/encoding/gob/decoder.go:212 +0xe6
Oct 27 04:56:08 nomad[6207]: encoding/gob.(*Decoder).Decode(0xc420662600, 0x12cde80, 0xc420ace000, 0x0, 0x0)
Oct 27 04:56:08 nomad[6207]: #011/usr/local/go/src/encoding/gob/decoder.go:189 +0x16d
Oct 27 04:56:08 nomad[6207]: net/rpc.(*gobClientCodec).ReadResponseHeader(0xc420946a80, 0xc420ace000, 0xc42092fcc0, 0x0)
Oct 27 04:56:08 nomad[6207]: #011/usr/local/go/src/net/rpc/client.go:223 +0x45
Oct 27 04:56:08 nomad[6207]: net/rpc.(*Client).input(0xc420171800)
Oct 27 04:56:08 nomad[6207]: #011/usr/local/go/src/net/rpc/client.go:109 +0xb5
Oct 27 04:56:08 nomad[6207]: created by net/rpc.NewClientWithCodec
Oct 27 04:56:08 nomad[6207]: #011/usr/local/go/src/net/rpc/client.go:201 +0xc5
Oct 27 04:56:08 nomad[6207]: goroutine 664770 [chan receive, 1865 minutes]:
Oct 27 04:56:08 nomad[6207]: github.com/hashicorp/nomad/vendor/github.com/hashicorp/go-plugin.(*Client).Start.func5.1(0xc420a963c0)
Oct 27 04:56:08 nomad[6207]: #011/build/nomad-0.7.0/src/github.com/hashicorp/nomad/vendor/github.com/hashicorp/go-plugin/client.go:570 +0x6d
Oct 27 04:56:08 nomad[6207]: created by github.com/hashicorp/nomad/vendor/github.com/hashicorp/go-plugin.(*Client).Start.func5
Oct 27 04:56:08 nomad[6207]: #011/build/nomad-0.7.0/src/github.com/hashicorp/nomad/vendor/github.com/hashicorp/go-plugin/client.go:569 +0x3f
Oct 27 04:56:08 nomad[6207]: goroutine 663720 [select, 1872 minutes]:
Oct 27 04:56:08 nomad[6207]: github.com/hashicorp/nomad/vendor/github.com/hashicorp/consul-template/manager.(*Runner).Start(0xc4205d4000)
Oct 27 04:56:08 nomad[6207]: #011/build/nomad-0.7.0/src/github.com/hashicorp/nomad/vendor/github.com/hashicorp/consul-template/manager/runner.go:324 +0x999
Oct 27 04:56:08 nomad[6207]: created by github.com/hashicorp/nomad/client.(*TaskTemplateManager).run
Oct 27 04:56:08 nomad[6207]: #011/build/nomad-0.7.0/src/github.com/hashicorp/nomad/client/consul_template.go:203 +0x50
Oct 27 04:56:08 nomad[6207]: goroutine 664251 [select, 1869 minutes]:
Oct 27 04:56:08 nomad[6207]: github.com/hashicorp/nomad/vendor/github.com/hashicorp/consul-template/watch.(*View).poll(0xc420013280, 0xc420a646c0, 0xc4209f8300)
Oct 27 04:56:08 nomad[6207]: #011/build/nomad-0.7.0/src/github.com/hashicorp/nomad/vendor/github.com/hashicorp/consul-template/watch/view.go:128 +0x1e8
Oct 27 04:56:08 nomad[6207]: created by github.com/hashicorp/nomad/vendor/github.com/hashicorp/consul-template/watch.(*Watcher).Add
Oct 27 04:56:08 nomad[6207]: #011/build/nomad-0.7.0/src/github.com/hashicorp/nomad/vendor/github.com/hashicorp/consul-template/watch/watcher.go:164 +0x48b
Oct 27 04:56:08 nomad[6207]: goroutine 663769 [select, 1872 minutes]:
Oct 27 04:56:08 nomad[6207]: github.com/hashicorp/nomad/vendor/github.com/hashicorp/yamux.(*Stream).Read(0xc4209f48f0, 0xc4208ca000, 0x1000, 0x1000, 0x0, 0x0, 0x0)
Oct 27 04:56:08 nomad[6207]: #011/build/nomad-0.7.0/src/github.com/hashicorp/nomad/vendor/github.com/hashicorp/yamux/stream.go:125 +0x270
Oct 27 04:56:08 nomad[6207]: bufio.(*Reader).Read(0xc420614900, 0xc420014dd0, 0x1, 0x9, 0xc420b6bca8, 0x42ca58, 0x3)
Oct 27 04:56:08 nomad[6207]: #011/usr/local/go/src/bufio/bufio.go:213 +0x30b
Oct 27 04:56:08 nomad[6207]: io.ReadAtLeast(0x1fbaec0, 0xc420614900, 0xc420014dd0, 0x1, 0x9, 0x1, 0xc42001d900, 0x15f6080, 0xc420837100)
Oct 27 04:56:08 nomad[6207]: #011/usr/local/go/src/io/io.go:309 +0x86
Oct 27 04:56:08 nomad[6207]: io.ReadFull(0x1fbaec0, 0xc420614900, 0xc420014dd0, 0x1, 0x9, 0xc420b6bd10, 0x40629b, 0x3)
Oct 27 04:56:08 nomad[6207]: #011/usr/local/go/src/io/io.go:327 +0x58
Oct 27 04:56:08 nomad[6207]: encoding/gob.decodeUintReader(0x1fbaec0, 0xc420614900, 0xc420014dd0, 0x9, 0x9, 0xc420b6bd88, 0x42c399, 0xc400000008, 0xc420961480)
Oct 27 04:56:08 nomad[6207]: #011/usr/local/go/src/encoding/gob/decode.go:120 +0x63
Oct 27 04:56:08 nomad[6207]: encoding/gob.(*Decoder).recvMessage(0xc420b39c80, 0xc420b6bda0)
Oct 27 04:56:08 nomad[6207]: #011/usr/local/go/src/encoding/gob/decoder.go:80 +0x57
Oct 27 04:56:08 nomad[6207]: encoding/gob.(*Decoder).decodeTypeSequence(0xc420b39c80, 0x15fa300, 0xc420b39c80)
Oct 27 04:56:08 nomad[6207]: #011/usr/local/go/src/encoding/gob/decoder.go:144 +0x14c
Oct 27 04:56:08 nomad[6207]: encoding/gob.(*Decoder).DecodeValue(0xc420b39c80, 0x12cde80, 0xc420a20cf0, 0x16, 0x0, 0x0)
Oct 27 04:56:08 nomad[6207]: #011/usr/local/go/src/encoding/gob/decoder.go:212 +0xe6
Oct 27 04:56:08 nomad[6207]: encoding/gob.(*Decoder).Decode(0xc420b39c80, 0x12cde80, 0xc420a20cf0, 0x0, 0x0)
Oct 27 04:56:08 nomad[6207]: #011/usr/local/go/src/encoding/gob/decoder.go:189 +0x16d
Oct 27 04:56:08 nomad[6207]: net/rpc.(*gobClientCodec).ReadResponseHeader(0xc420a20c60, 0xc420a20cf0, 0xc420014ddc, 0x0)
Oct 27 04:56:08 nomad[6207]: #011/usr/local/go/src/net/rpc/client.go:223 +0x45
Oct 27 04:56:08 nomad[6207]: net/rpc.(*Client).input(0xc420614a20)
Oct 27 04:56:08 nomad[6207]: #011/usr/local/go/src/net/rpc/client.go:109 +0xb5
Oct 27 04:56:08 nomad[6207]: created by net/rpc.NewClientWithCodec
Oct 27 04:56:08 nomad[6207]: #011/usr/local/go/src/net/rpc/client.go:201 +0xc5
Oct 27 04:56:08 nomad[6207]: goroutine 664653 [select, 1865 minutes]:
Oct 27 04:56:08 nomad[6207]: github.com/hashicorp/nomad/client.(*AllocRunner).Run(0xc42025bce0)
Oct 27 04:56:08 nomad[6207]: #011/build/nomad-0.7.0/src/github.com/hashicorp/nomad/client/alloc_runner.go:823 +0xa7c
Oct 27 04:56:08 nomad[6207]: created by github.com/hashicorp/nomad/client.(*Client).addAlloc
Oct 27 04:56:08 nomad[6207]: #011/build/nomad-0.7.0/src/github.com/hashicorp/nomad/client/client.go:1629 +0x48c
Oct 27 04:56:08 nomad[6207]: goroutine 664721 [IO wait, 1865 minutes]:
Oct 27 04:56:08 nomad[6207]: internal/poll.runtime_pollWait(0x7f05e6ce1f70, 0x72, 0x1)
Oct 27 04:56:08 nomad[6207]: #011/usr/local/go/src/runtime/netpoll.go:173 +0x57
Oct 27 04:56:08 nomad[6207]: internal/poll.(*pollDesc).wait(0xc42013ce28, 0x72, 0xffffffffffffff01, 0x1fc0ac0, 0x1fb92d8)
Oct 27 04:56:08 nomad[6207]: #011/usr/local/go/src/internal/poll/fd_poll_runtime.go:85 +0xae
Oct 27 04:56:08 nomad[6207]: internal/poll.(*pollDesc).waitRead(0xc42013ce28, 0xc420aa0001, 0x8000, 0x8000)
Oct 27 04:56:08 nomad[6207]: #011/usr/local/go/src/internal/poll/fd_poll_runtime.go:90 +0x3d
Oct 27 04:56:08 nomad[6207]: internal/poll.(*FD).Read(0xc42013ce10, 0xc420aa0000, 0x8000, 0x8000, 0x0, 0x0, 0x0)
Oct 27 04:56:08 nomad[6207]: #011/usr/local/go/src/internal/poll/fd_unix.go:125 +0x18a
Oct 27 04:56:08 nomad[6207]: os.(*File).read(0xc4201c5268, 0xc420aa0000, 0x8000, 0x8000, 0xc4203e3660, 0x46adcc, 0xc4200eb680)
Oct 27 04:56:08 nomad[6207]: #011/usr/local/go/src/os/file_unix.go:216 +0x4e
Oct 27 04:56:08 nomad[6207]: os.(*File).Read(0xc4201c5268, 0xc420aa0000, 0x8000, 0x8000, 0x8c, 0x0, 0x0)
Oct 27 04:56:08 nomad[6207]: #011/usr/local/go/src/os/file.go:103 +0x6d
Oct 27 04:56:08 nomad[6207]: io.copyBuffer(0x1fbd800, 0xc4201c5240, 0x1fbe480, 0xc4201c5268, 0xc420aa0000, 0x8000, 0x8000, 0x18, 0x1c, 0xc4207bb200)
Oct 27 04:56:08 nomad[6207]: #011/usr/local/go/src/io/io.go:392 +0x123
Oct 27 04:56:08 nomad[6207]: io.Copy(0x1fbd800, 0xc4201c5240, 0x1fbe480, 0xc4201c5268, 0xc4203e3730, 0xc420539500, 0x7200e4)
Oct 27 04:56:08 nomad[6207]: #011/usr/local/go/src/io/io.go:362 +0x68
Oct 27 04:56:08 nomad[6207]: os/exec.(*Cmd).writerDescriptor.func1(0x45ee21, 0x200e9e0)
Oct 27 04:56:08 nomad[6207]: #011/usr/local/go/src/os/exec/exec.go:264 +0x4d
Oct 27 04:56:08 nomad[6207]: os/exec.(*Cmd).Start.func1(0xc4202c9340, 0xc420150b00)
Oct 27 04:56:08 nomad[6207]: #011/usr/local/go/src/os/exec/exec.go:380 +0x27
Oct 27 04:56:08 nomad[6207]: created by os/exec.(*Cmd).Start
Oct 27 04:56:08 nomad[6207]: #011/usr/local/go/src/os/exec/exec.go:379 +0x646
Oct 27 04:56:08 nomad[6207]: goroutine 663783 [semacquire, 1872 minutes]:
Oct 27 04:56:08 nomad[6207]: sync.runtime_notifyListWait(0xc4200eb300, 0xc400000001)
Oct 27 04:56:08 nomad[6207]: #011/usr/local/go/src/runtime/sema.go:507 +0x110
Oct 27 04:56:08 nomad[6207]: sync.(*Cond).Wait(0xc4200eb2f0)
Oct 27 04:56:08 nomad[6207]: #011/usr/local/go/src/sync/cond.go:56 +0x80
Oct 27 04:56:08 nomad[6207]: io.(*pipe).read(0xc4200eb2c0, 0xc420732000, 0x1000, 0x1000, 0x0, 0x0, 0x0)
Oct 27 04:56:08 nomad[6207]: #011/usr/local/go/src/io/pipe.go:47 +0xc6
Oct 27 04:56:08 nomad[6207]: io.(*PipeReader).Read(0xc4201c4348, 0xc420732000, 0x1000, 0x1000, 0x7f05e6caaf58, 0x0, 0x0)
Oct 27 04:56:08 nomad[6207]: #011/usr/local/go/src/io/pipe.go:130 +0x4c
Oct 27 04:56:08 nomad[6207]: bufio.(*Reader).fill(0xc420849768)
Oct 27 04:56:08 nomad[6207]: #011/usr/local/go/src/bufio/bufio.go:97 +0x11a
Oct 27 04:56:08 nomad[6207]: bufio.(*Reader).ReadSlice(0xc420849768, 0xc42084960a, 0x405fa8, 0xc42014c540, 0xc42063e660, 0xc4208496f8, 0xc420849658)
Oct 27 04:56:08 nomad[6207]: #011/usr/local/go/src/bufio/bufio.go:338 +0x2c
Oct 27 04:56:08 nomad[6207]: bufio.(*Reader).ReadBytes(0xc420849768, 0xc42084960a, 0xc4206fb4d0, 0x25, 0x25, 0x0, 0x0)
Oct 27 04:56:08 nomad[6207]: #011/usr/local/go/src/bufio/bufio.go:416 +0x6b
Oct 27 04:56:08 nomad[6207]: github.com/hashicorp/nomad/vendor/github.com/hashicorp/go-plugin.(*Client).Start.func4(0xc42014c540, 0xc4201c4348)
Oct 27 04:56:08 nomad[6207]: #011/build/nomad-0.7.0/src/github.com/hashicorp/nomad/vendor/github.com/hashicorp/go-plugin/client.go:555 +0x16c
Oct 27 04:56:08 nomad[6207]: created by github.com/hashicorp/nomad/vendor/github.com/hashicorp/go-plugin.(*Client).Start
Oct 27 04:56:08 nomad[6207]: #011/build/nomad-0.7.0/src/github.com/hashicorp/nomad/vendor/github.com/hashicorp/go-plugin/client.go:550 +0xdaf
Oct 27 04:56:08 nomad[6207]: goroutine 664740 [select, 1865 minutes]:
Oct 27 04:56:08 nomad[6207]: github.com/hashicorp/nomad/vendor/github.com/hashicorp/consul-template/watch.(*View).poll(0xc4205d3380, 0xc420863da0, 0xc4207eec60)
Oct 27 04:56:08 nomad[6207]: #011/build/nomad-0.7.0/src/github.com/hashicorp/nomad/vendor/github.com/hashicorp/consul-template/watch/view.go:128 +0x1e8
Oct 27 04:56:08 nomad[6207]: created by github.com/hashicorp/nomad/vendor/github.com/hashicorp/consul-template/watch.(*Watcher).Add
Oct 27 04:56:08 nomad[6207]: #011/build/nomad-0.7.0/src/github.com/hashicorp/nomad/vendor/github.com/hashicorp/consul-template/watch/watcher.go:164 +0x48b
Oct 27 04:56:08 nomad[6207]: goroutine 664279 [IO wait]:
Oct 27 04:56:08 nomad[6207]: internal/poll.runtime_pollWait(0x7f05e6ce1c70, 0x72, 0x0)
Oct 27 04:56:08 nomad[6207]: #011/usr/local/go/src/runtime/netpoll.go:173 +0x57
Oct 27 04:56:08 nomad[6207]: internal/poll.(*pollDesc).wait(0xc420662598, 0x72, 0xffffffffffffff00, 0x1fc0ac0, 0x1fb92d8)
Oct 27 04:56:08 nomad[6207]: #011/usr/local/go/src/internal/poll/fd_poll_runtime.go:85 +0xae
Oct 27 04:56:08 nomad[6207]: internal/poll.(*pollDesc).waitRead(0xc420662598, 0xc4205bb000, 0x1000, 0x1000)
Oct 27 04:56:08 nomad[6207]: #011/usr/local/go/src/internal/poll/fd_poll_runtime.go:90 +0x3d
Oct 27 04:56:08 nomad[6207]: internal/poll.(*FD).Read(0xc420662580, 0xc4205bb000, 0x1000, 0x1000, 0x0, 0x0, 0x0)
Oct 27 04:56:08 nomad[6207]: #011/usr/local/go/src/internal/poll/fd_unix.go:125 +0x18a
Oct 27 04:56:08 nomad[6207]: net.(*netFD).Read(0xc420662580, 0xc4205bb000, 0x1000, 0x1000, 0xc42092fac0, 0x0, 0x0)
Oct 27 04:56:08 nomad[6207]: #011/usr/local/go/src/net/fd_unix.go:202 +0x52
Oct 27 04:56:08 nomad[6207]: net.(*conn).Read(0xc4201c4168, 0xc4205bb000, 0x1000, 0x1000, 0x0, 0x0, 0x0)
Oct 27 04:56:08 nomad[6207]: #011/usr/local/go/src/net/net.go:176 +0x6d
Oct 27 04:56:08 nomad[6207]: bufio.(*Reader).Read(0xc42067e900, 0xc4204f7840, 0xc, 0xc, 0xc420381320, 0x2010780, 0x0)
Oct 27 04:56:08 nomad[6207]: #011/usr/local/go/src/bufio/bufio.go:213 +0x30b
Oct 27 04:56:08 nomad[6207]: io.ReadAtLeast(0x1fbaec0, 0xc42067e900, 0xc4204f7840, 0xc, 0xc, 0xc, 0xc, 0x0, 0x0)
Oct 27 04:56:08 nomad[6207]: #011/usr/local/go/src/io/io.go:309 +0x86
Oct 27 04:56:08 nomad[6207]: io.ReadFull(0x1fbaec0, 0xc42067e900, 0xc4204f7840, 0xc, 0xc, 0xc, 0x0, 0x0)
Oct 27 04:56:08 nomad[6207]: #011/usr/local/go/src/io/io.go:327 +0x58
Oct 27 04:56:08 nomad[6207]: github.com/hashicorp/nomad/vendor/github.com/hashicorp/yamux.(*Session).recvLoop(0xc420b88420, 0x0, 0x0)
Oct 27 04:56:08 nomad[6207]: #011/build/nomad-0.7.0/src/github.com/hashicorp/nomad/vendor/github.com/hashicorp/yamux/session.go:418 +0xfc
Oct 27 04:56:08 nomad[6207]: github.com/hashicorp/nomad/vendor/github.com/hashicorp/yamux.(*Session).recv(0xc420b88420)
Oct 27 04:56:08 nomad[6207]: #011/build/nomad-0.7.0/src/github.com/hashicorp/nomad/vendor/github.com/hashicorp/yamux/session.go:406 +0x2b
Oct 27 04:56:08 nomad[6207]: created by github.com/hashicorp/nomad/vendor/github.com/hashicorp/yamux.newSession
Oct 27 04:56:08 nomad[6207]: #011/build/nomad-0.7.0/src/github.com/hashicorp/nomad/vendor/github.com/hashicorp/yamux/session.go:108 +0x3e4
Oct 27 04:56:08 nomad[6207]: goroutine 848883 [IO wait]:
Oct 27 04:56:08 nomad[6207]: internal/poll.runtime_pollWait(0x7f05e6ce14f0, 0x72, 0x0)
Oct 27 04:56:08 nomad[6207]: #011/usr/local/go/src/runtime/netpoll.go:173 +0x57
Oct 27 04:56:08 nomad[6207]: internal/poll.(*pollDesc).wait(0xc4201e5318, 0x72, 0xffffffffffffff00, 0x1fc0ac0, 0x1fb92d8)
Oct 27 04:56:08 nomad[6207]: #011/usr/local/go/src/internal/poll/fd_poll_runtime.go:85 +0xae
Oct 27 04:56:08 nomad[6207]: internal/poll.(*pollDesc).waitRead(0xc4201e5318, 0xc4206c7000, 0x1000, 0x1000)
Oct 27 04:56:08 nomad[6207]: #011/usr/local/go/src/internal/poll/fd_poll_runtime.go:90 +0x3d
Oct 27 04:56:08 nomad[6207]: internal/poll.(*FD).Read(0xc4201e5300, 0xc4206c7000, 0x1000, 0x1000, 0x0, 0x0, 0x0)
Oct 27 04:56:08 nomad[6207]: #011/usr/local/go/src/internal/poll/fd_unix.go:125 +0x18a
Oct 27 04:56:08 nomad[6207]: net.(*netFD).Read(0xc4201e5300, 0xc4206c7000, 0x1000, 0x1000, 0x42f78b, 0xc4202e4a40, 0x45aea0)
Oct 27 04:56:08 nomad[6207]: #011/usr/local/go/src/net/fd_unix.go:202 +0x52
Oct 27 04:56:08 nomad[6207]: net.(*conn).Read(0xc42000e710, 0xc4206c7000, 0x1000, 0x1000, 0x0, 0x0, 0x0)
Oct 27 04:56:08 nomad[6207]: #011/usr/local/go/src/net/net.go:176 +0x6d
Oct 27 04:56:08 nomad[6207]: net/http.(*persistConn).Read(0xc42029fb00, 0xc4206c7000, 0x1000, 0x1000, 0xc420439d00, 0xc420693df8, 0x458f00)
Oct 27 04:56:08 nomad[6207]: #011/usr/local/go/src/net/http/transport.go:1391 +0x140
Oct 27 04:56:08 nomad[6207]: bufio.(*Reader).fill(0xc42062c120)
Oct 27 04:56:08 nomad[6207]: #011/usr/local/go/src/bufio/bufio.go:97 +0x11a
Oct 27 04:56:08 nomad[6207]: bufio.(*Reader).Peek(0xc42062c120, 0x1, 0x0, 0x0, 0x0, 0xc4209fc840, 0x0)
Oct 27 04:56:08 nomad[6207]: #011/usr/local/go/src/bufio/bufio.go:129 +0x3a
Oct 27 04:56:08 nomad[6207]: net/http.(*persistConn).readLoop(0xc42029fb00)
Oct 27 04:56:08 nomad[6207]: #011/usr/local/go/src/net/http/transport.go:1539 +0x185
Oct 27 04:56:08 nomad[6207]: created by net/http.(*Transport).dialConn
Oct 27 04:56:08 nomad[6207]: #011/usr/local/go/src/net/http/transport.go:1186 +0xa2e
Oct 27 04:56:08 nomad[6207]: goroutine 664281 [select]:
Oct 27 04:56:08 nomad[6207]: github.com/hashicorp/nomad/vendor/github.com/hashicorp/yamux.(*Session).keepalive(0xc420b88420)
Oct 27 04:56:08 nomad[6207]: #011/build/nomad-0.7.0/src/github.com/hashicorp/nomad/vendor/github.com/hashicorp/yamux/session.go:302 +0x102
Oct 27 04:56:08 nomad[6207]: created by github.com/hashicorp/nomad/vendor/github.com/hashicorp/yamux.newSession
Oct 27 04:56:08 nomad[6207]: #011/build/nomad-0.7.0/src/github.com/hashicorp/nomad/vendor/github.com/hashicorp/yamux/session.go:111 +0x455
Oct 27 04:56:08 nomad[6207]: goroutine 664282 [select, 1869 minutes]:
Oct 27 04:56:08 nomad[6207]: github.com/hashicorp/nomad/vendor/github.com/hashicorp/yamux.(*Session).AcceptStream(0xc420b88420, 0x0, 0x0, 0x0)
Oct 27 04:56:08 nomad[6207]: #011/build/nomad-0.7.0/src/github.com/hashicorp/nomad/vendor/github.com/hashicorp/yamux/session.go:201 +0xf2
Oct 27 04:56:08 nomad[6207]: github.com/hashicorp/nomad/vendor/github.com/hashicorp/go-plugin.(*MuxBroker).Run(0xc4205e0e20)
Oct 27 04:56:08 nomad[6207]: #011/build/nomad-0.7.0/src/github.com/hashicorp/nomad/vendor/github.com/hashicorp/go-plugin/mux_broker.go:139 +0x33
Oct 27 04:56:08 nomad[6207]: created by github.com/hashicorp/nomad/vendor/github.com/hashicorp/go-plugin.NewRPCClient
Oct 27 04:56:08 nomad[6207]: #011/build/nomad-0.7.0/src/github.com/hashicorp/nomad/vendor/github.com/hashicorp/go-plugin/rpc_client.go:88 +0x22f
Oct 27 04:56:08 nomad[6207]: goroutine 664725 [select]:
Oct 27 04:56:08 nomad[6207]: github.com/hashicorp/nomad/client.(*TaskRunner).collectResourceUsageStats(0xc4201eb520, 0xc420ac0120)
Oct 27 04:56:08 nomad[6207]: #011/build/nomad-0.7.0/src/github.com/hashicorp/nomad/client/task_runner.go:1556 +0x129
Oct 27 04:56:08 nomad[6207]: created by github.com/hashicorp/nomad/client.(*TaskRunner).run
Oct 27 04:56:08 nomad[6207]: #011/build/nomad-0.7.0/src/github.com/hashicorp/nomad/client/task_runner.go:1126 +0x15de
Oct 27 04:56:08 nomad[6207]: goroutine 664248 [select, 1869 minutes]:
Oct 27 04:56:08 nomad[6207]: github.com/hashicorp/nomad/client.(*TaskTemplateManager).handleTemplateRerenders(0xc4200540c0, 0xbe745f6e4cd3b007, 0x16edf9fa1b7e2, 0x20105c0)
Oct 27 04:56:08 nomad[6207]: #011/build/nomad-0.7.0/src/github.com/hashicorp/nomad/client/consul_template.go:354 +0x238
Oct 27 04:56:08 nomad[6207]: github.com/hashicorp/nomad/client.(*TaskTemplateManager).run(0xc4200540c0)
Oct 27 04:56:08 nomad[6207]: #011/build/nomad-0.7.0/src/github.com/hashicorp/nomad/client/consul_template.go:232 +0x170
Oct 27 04:56:08 nomad[6207]: created by github.com/hashicorp/nomad/client.NewTaskTemplateManager
Oct 27 04:56:08 nomad[6207]: #011/build/nomad-0.7.0/src/github.com/hashicorp/nomad/client/consul_template.go:171 +0x377
Oct 27 04:56:08 nomad[6207]: goroutine 663772 [select]:
Oct 27 04:56:08 nomad[6207]: github.com/hashicorp/nomad/vendor/github.com/hashicorp/yamux.(*Stream).Read(0xc4209f31e0, 0xc420b6e000, 0x1000, 0x1000, 0x0, 0x0, 0x0)
Oct 27 04:56:08 nomad[6207]: #011/build/nomad-0.7.0/src/github.com/hashicorp/nomad/vendor/github.com/hashicorp/yamux/stream.go:125 +0x270
Oct 27 04:56:08 nomad[6207]: bufio.(*Reader).Read(0xc420614b40, 0xc420014e30, 0x1, 0x9, 0xc4209ffca8, 0x42ca58, 0x15f6080)
Oct 27 04:56:08 nomad[6207]: #011/usr/local/go/src/bufio/bufio.go:213 +0x30b
Oct 27 04:56:08 nomad[6207]: io.ReadAtLeast(0x1fbaec0, 0xc420614b40, 0xc420014e30, 0x1, 0x9, 0x1, 0xc42001a000, 0xc42053a4b0, 0x195)
Oct 27 04:56:08 nomad[6207]: #011/usr/local/go/src/io/io.go:309 +0x86
Oct 27 04:56:08 nomad[6207]: io.ReadFull(0x1fbaec0, 0xc420614b40, 0xc420014e30, 0x1, 0x9, 0xc4209ffd10, 0x40629b, 0x3)
Oct 27 04:56:08 nomad[6207]: #011/usr/local/go/src/io/io.go:327 +0x58
Oct 27 04:56:08 nomad[6207]: encoding/gob.decodeUintReader(0x1fbaec0, 0xc420614b40, 0xc420014e30, 0x9, 0x9, 0xc4209ffd88, 0x42c399, 0xc400000008, 0xc4206bfd00)
Oct 27 04:56:08 nomad[6207]: #011/usr/local/go/src/encoding/gob/decode.go:120 +0x63
Oct 27 04:56:08 nomad[6207]: encoding/gob.(*Decoder).recvMessage(0xc420b39d00, 0xc4209ffda0)
Oct 27 04:56:08 nomad[6207]: #011/usr/local/go/src/encoding/gob/decoder.go:80 +0x57
Oct 27 04:56:08 nomad[6207]: encoding/gob.(*Decoder).decodeTypeSequence(0xc420b39d00, 0x15fa300, 0xc420b39d00)
Oct 27 04:56:08 nomad[6207]: #011/usr/local/go/src/encoding/gob/decoder.go:144 +0x14c
Oct 27 04:56:08 nomad[6207]: encoding/gob.(*Decoder).DecodeValue(0xc420b39d00, 0x12cde80, 0xc42059c450, 0x16, 0x0, 0x0)
Oct 27 04:56:08 nomad[6207]: #011/usr/local/go/src/encoding/gob/decoder.go:212 +0xe6
Oct 27 04:56:08 nomad[6207]: encoding/gob.(*Decoder).Decode(0xc420b39d00, 0x12cde80, 0xc42059c450, 0x0, 0x0)
Oct 27 04:56:08 nomad[6207]: #011/usr/local/go/src/encoding/gob/decoder.go:189 +0x16d
Oct 27 04:56:08 nomad[6207]: net/rpc.(*gobClientCodec).ReadResponseHeader(0xc420a20e40, 0xc42059c450, 0xc42053a4a0, 0x0)
Oct 27 04:56:08 nomad[6207]: #011/usr/local/go/src/net/rpc/client.go:223 +0x45
Oct 27 04:56:08 nomad[6207]: net/rpc.(*Client).input(0xc420614c00)
Oct 27 04:56:08 nomad[6207]: #011/usr/local/go/src/net/rpc/client.go:109 +0xb5
Oct 27 04:56:08 nomad[6207]: created by net/rpc.NewClientWithCodec
Oct 27 04:56:08 nomad[6207]: #011/usr/local/go/src/net/rpc/client.go:201 +0xc5
Oct 27 04:56:08 nomad[6207]: goroutine 664756 [semacquire, 1865 minutes]:
Oct 27 04:56:08 nomad[6207]: sync.runtime_notifyListWait(0xc4200eb600, 0xc400000001)
Oct 27 04:56:08 nomad[6207]: #011/usr/local/go/src/runtime/sema.go:507 +0x110
Oct 27 04:56:08 nomad[6207]: sync.(*Cond).Wait(0xc4200eb5f0)
Oct 27 04:56:08 nomad[6207]: #011/usr/local/go/src/sync/cond.go:56 +0x80
Oct 27 04:56:08 nomad[6207]: io.(*pipe).read(0xc4200eb5c0, 0xc420ab2000, 0x1000, 0x1000, 0x0, 0x0, 0x0)
Oct 27 04:56:08 nomad[6207]: #011/usr/local/go/src/io/pipe.go:47 +0xc6
Oct 27 04:56:08 nomad[6207]: io.(*PipeReader).Read(0xc4201c5228, 0xc420ab2000, 0x1000, 0x1000, 0x2010780, 0x0, 0x0)
Oct 27 04:56:08 nomad[6207]: #011/usr/local/go/src/io/pipe.go:130 +0x4c
Oct 27 04:56:08 nomad[6207]: bufio.(*Reader).fill(0xc4203e2768)
Oct 27 04:56:08 nomad[6207]: #011/usr/local/go/src/bufio/bufio.go:97 +0x11a
Oct 27 04:56:08 nomad[6207]: bufio.(*Reader).ReadSlice(0xc4203e2768, 0xc4203e260a, 0x405fa8, 0xc420a963c0, 0xc420480360, 0xc4203e26f8, 0xc4203e2658)
Oct 27 04:56:08 nomad[6207]: #011/usr/local/go/src/bufio/bufio.go:338 +0x2c
Oct 27 04:56:08 nomad[6207]: bufio.(*Reader).ReadBytes(0xc4203e2768, 0xc4203e260a, 0xc420ab6000, 0x25, 0x25, 0x0, 0x0)
Oct 27 04:56:08 nomad[6207]: #011/usr/local/go/src/bufio/bufio.go:416 +0x6b
Oct 27 04:56:08 nomad[6207]: github.com/hashicorp/nomad/vendor/github.com/hashicorp/go-plugin.(*Client).Start.func4(0xc420a963c0, 0xc4201c5228)
Oct 27 04:56:08 nomad[6207]: #011/build/nomad-0.7.0/src/github.com/hashicorp/nomad/vendor/github.com/hashicorp/go-plugin/client.go:555 +0x16c
Oct 27 04:56:08 nomad[6207]: created by github.com/hashicorp/nomad/vendor/github.com/hashicorp/go-plugin.(*Client).Start
Oct 27 04:56:08 nomad[6207]: #011/build/nomad-0.7.0/src/github.com/hashicorp/nomad/vendor/github.com/hashicorp/go-plugin/client.go:550 +0xdaf
Oct 27 04:56:08 nomad[6207]: goroutine 663773 [chan receive, 1872 minutes]:
Oct 27 04:56:08 nomad[6207]: net/rpc.(*Client).Call(0xc420614c00, 0x1596c55, 0xb, 0x12b4e40, 0xc4205eba50, 0x12a1740, 0xc4209bc380, 0x4, 0x42f78b)
Oct 27 04:56:08 nomad[6207]: #011/usr/local/go/src/net/rpc/client.go:317 +0xbc
Oct 27 04:56:08 nomad[6207]: github.com/hashicorp/nomad/client/driver.(*ExecutorRPC).Wait(0xc420193d80, 0x20002, 0xc4208487c4, 0xc4208487c0)
Oct 27 04:56:08 nomad[6207]: #011/build/nomad-0.7.0/src/github.com/hashicorp/nomad/client/driver/executor_plugin.go:62 +0x9d
Oct 27 04:56:08 nomad[6207]: github.com/hashicorp/nomad/client/driver.(*execHandle).run(0xc420302a80)
Oct 27 04:56:08 nomad[6207]: #011/build/nomad-0.7.0/src/github.com/hashicorp/nomad/client/driver/exec.go:293 +0x49
Oct 27 04:56:08 nomad[6207]: created by github.com/hashicorp/nomad/client/driver.(*ExecDriver).Start
Oct 27 04:56:08 nomad[6207]: #011/build/nomad-0.7.0/src/github.com/hashicorp/nomad/client/driver/exec.go:163 +0x6bc
Oct 27 04:56:08 nomad[6207]: goroutine 663767 [select]:
Oct 27 04:56:08 nomad[6207]: github.com/hashicorp/nomad/vendor/github.com/hashicorp/yamux.(*Session).keepalive(0xc4201ff550)
Oct 27 04:56:08 nomad[6207]: #011/build/nomad-0.7.0/src/github.com/hashicorp/nomad/vendor/github.com/hashicorp/yamux/session.go:302 +0x102
Oct 27 04:56:08 nomad[6207]: created by github.com/hashicorp/nomad/vendor/github.com/hashicorp/yamux.newSession
Oct 27 04:56:08 nomad[6207]: #011/build/nomad-0.7.0/src/github.com/hashicorp/nomad/vendor/github.com/hashicorp/yamux/session.go:111 +0x455
Oct 27 04:56:08 nomad[6207]: goroutine 663782 [semacquire, 1872 minutes]:
Oct 27 04:56:08 nomad[6207]: sync.runtime_notifyListWait(0xc4200eb3c0, 0xc400000001)
Oct 27 04:56:08 nomad[6207]: #011/usr/local/go/src/runtime/sema.go:507 +0x110
Oct 27 04:56:08 nomad[6207]: sync.(*Cond).Wait(0xc4200eb3b0)
Oct 27 04:56:08 nomad[6207]: #011/usr/local/go/src/sync/cond.go:56 +0x80
Oct 27 04:56:08 nomad[6207]: io.(*pipe).read(0xc4200eb380, 0xc420730000, 0x1000, 0x1000, 0x0, 0x0, 0x0)
Oct 27 04:56:08 nomad[6207]: #011/usr/local/go/src/io/pipe.go:47 +0xc6
Oct 27 04:56:08 nomad[6207]: io.(*PipeReader).Read(0xc4201c4368, 0xc420730000, 0x1000, 0x1000, 0x8c, 0x0, 0x0)
Oct 27 04:56:08 nomad[6207]: #011/usr/local/go/src/io/pipe.go:130 +0x4c
Oct 27 04:56:08 nomad[6207]: bufio.(*Reader).fill(0xc42097af60)
Oct 27 04:56:08 nomad[6207]: #011/usr/local/go/src/bufio/bufio.go:97 +0x11a
Oct 27 04:56:08 nomad[6207]: bufio.(*Reader).ReadSlice(0xc42097af60, 0xc42001c60a, 0xc42097ad90, 0x4fe17e, 0xc42000e020, 0xc42097ad90, 0x42cd36)
Oct 27 04:56:08 nomad[6207]: #011/usr/local/go/src/bufio/bufio.go:338 +0x2c
Oct 27 04:56:08 nomad[6207]: bufio.(*Reader).ReadBytes(0xc42097af60, 0xc01f0a, 0xc4207b00f0, 0x2, 0xc4203602d0, 0xe, 0xc4207b6780)
Oct 27 04:56:08 nomad[6207]: #011/usr/local/go/src/bufio/bufio.go:416 +0x6b
Oct 27 04:56:08 nomad[6207]: bufio.(*Reader).ReadString(0xc42097af60, 0xc42036020a, 0xe, 0xc4207b6780, 0x4, 0x4)
Oct 27 04:56:08 nomad[6207]: #011/usr/local/go/src/bufio/bufio.go:456 +0x38
Oct 27 04:56:08 nomad[6207]: github.com/hashicorp/nomad/vendor/github.com/hashicorp/go-plugin.(*Client).logStderr(0xc4202ec150, 0x1fbd7c0, 0xc4201c4368)
Oct 27 04:56:08 nomad[6207]: #011/build/nomad-0.7.0/src/github.com/hashicorp/nomad/vendor/github.com/hashicorp/go-plugin/client.go:735 +0xab
Oct 27 04:56:08 nomad[6207]: created by github.com/hashicorp/nomad/vendor/github.com/hashicorp/go-plugin.(*Client).Start
Oct 27 04:56:08 nomad[6207]: #011/build/nomad-0.7.0/src/github.com/hashicorp/nomad/vendor/github.com/hashicorp/go-plugin/client.go:545 +0xd64
Oct 27 04:56:08 nomad[6207]: goroutine 663764 [chan receive, 1872 minutes]:
Oct 27 04:56:08 nomad[6207]: github.com/hashicorp/nomad/vendor/github.com/hashicorp/go-plugin.(*Client).Start.func5.1(0xc42014c540)
Oct 27 04:56:08 nomad[6207]: #011/build/nomad-0.7.0/src/github.com/hashicorp/nomad/vendor/github.com/hashicorp/go-plugin/client.go:570 +0x6d
Oct 27 04:56:08 nomad[6207]: created by github.com/hashicorp/nomad/vendor/github.com/hashicorp/go-plugin.(*Client).Start.func5
Oct 27 04:56:08 nomad[6207]: #011/build/nomad-0.7.0/src/github.com/hashicorp/nomad/vendor/github.com/hashicorp/go-plugin/client.go:569 +0x3f
Oct 27 04:56:08 nomad[6207]: goroutine 663751 [select, 1872 minutes]:
Oct 27 04:56:08 nomad[6207]: github.com/hashicorp/nomad/vendor/github.com/hashicorp/consul-template/dependency.(*VaultReadQuery).Fetch(0xc4201d5230, 0xc420947a10, 0xc4205c4140, 0x0, 0x0, 0x0, 0x0, 0x0)
Oct 27 04:56:08 nomad[6207]: #011/build/nomad-0.7.0/src/github.com/hashicorp/nomad/vendor/github.com/hashicorp/consul-template/dependency/vault_read.go:89 +0xacb
Oct 27 04:56:08 nomad[6207]: github.com/hashicorp/nomad/vendor/github.com/hashicorp/consul-template/watch.(*View).fetch(0xc420b38d00, 0xc42013fc80, 0xc42013fd40, 0xc4207c0f00)
Oct 27 04:56:08 nomad[6207]: #011/build/nomad-0.7.0/src/github.com/hashicorp/nomad/vendor/github.com/hashicorp/consul-template/watch/view.go:210 +0x147
Oct 27 04:56:08 nomad[6207]: created by github.com/hashicorp/nomad/vendor/github.com/hashicorp/consul-template/watch.(*View).poll
Oct 27 04:56:08 nomad[6207]: #011/build/nomad-0.7.0/src/github.com/hashicorp/nomad/vendor/github.com/hashicorp/consul-template/watch/view.go:125 +0x516
Oct 27 04:56:08 nomad[6207]: goroutine 664263 [chan receive, 1869 minutes]:
Oct 27 04:56:08 nomad[6207]: net/rpc.(*Client).Call(0xc420a656e0, 0x1596c55, 0xb, 0x12b4e40, 0xc4204e1d70, 0x12a1740, 0xc4209d11c0, 0x158c435, 0x1)
Oct 27 04:56:08 nomad[6207]: #011/usr/local/go/src/net/rpc/client.go:317 +0xbc
Oct 27 04:56:08 nomad[6207]: github.com/hashicorp/nomad/client/driver.(*ExecutorRPC).Wait(0xc420497740, 0x406594, 0xc4202b89b8, 0x0)
Oct 27 04:56:08 nomad[6207]: #011/build/nomad-0.7.0/src/github.com/hashicorp/nomad/client/driver/executor_plugin.go:62 +0x9d
Oct 27 04:56:08 nomad[6207]: github.com/hashicorp/nomad/client/driver.(*execHandle).run(0xc4202b17a0)
Oct 27 04:56:08 nomad[6207]: #011/build/nomad-0.7.0/src/github.com/hashicorp/nomad/client/driver/exec.go:293 +0x49
Oct 27 04:56:08 nomad[6207]: created by github.com/hashicorp/nomad/client/driver.(*ExecDriver).Start
Oct 27 04:56:08 nomad[6207]: #011/build/nomad-0.7.0/src/github.com/hashicorp/nomad/client/driver/exec.go:163 +0x6bc
Oct 27 04:56:08 nomad[6207]: goroutine 663745 [select, 1872 minutes]:
Oct 27 04:56:08 nomad[6207]: github.com/hashicorp/nomad/vendor/github.com/hashicorp/consul-template/dependency.(*VaultReadQuery).Fetch(0xc4201d4ea0, 0xc420947a10, 0xc420495d10, 0x0, 0x0, 0x0, 0x0, 0x0)
Oct 27 04:56:08 nomad[6207]: #011/build/nomad-0.7.0/src/github.com/hashicorp/nomad/vendor/github.com/hashicorp/consul-template/dependency/vault_read.go:89 +0xacb
Oct 27 04:56:08 nomad[6207]: github.com/hashicorp/nomad/vendor/github.com/hashicorp/consul-template/watch.(*View).fetch(0xc420b38c80, 0xc4209fbb00, 0xc4209fbb60, 0xc420862f00)
Oct 27 04:56:08 nomad[6207]: #011/build/nomad-0.7.0/src/github.com/hashicorp/nomad/vendor/github.com/hashicorp/consul-template/watch/view.go:210 +0x147
Oct 27 04:56:08 nomad[6207]: created by github.com/hashicorp/nomad/vendor/github.com/hashicorp/consul-template/watch.(*View).poll
Oct 27 04:56:08 nomad[6207]: #011/build/nomad-0.7.0/src/github.com/hashicorp/nomad/vendor/github.com/hashicorp/consul-template/watch/view.go:125 +0x516
Oct 27 04:56:08 nomad[6207]: goroutine 664223 [select, 1869 minutes]:
Oct 27 04:56:08 nomad[6207]: github.com/hashicorp/nomad/vendor/github.com/hashicorp/consul-template/dependency.(*VaultReadQuery).Fetch(0xc420141ef0, 0xc4201402a0, 0xc4205c45f0, 0x0, 0x0, 0x0, 0x0, 0x0)
Oct 27 04:56:08 nomad[6207]: #011/build/nomad-0.7.0/src/github.com/hashicorp/nomad/vendor/github.com/hashicorp/consul-template/dependency/vault_read.go:89 +0xacb
Oct 27 04:56:08 nomad[6207]: github.com/hashicorp/nomad/vendor/github.com/hashicorp/consul-template/watch.(*View).fetch(0xc420013280, 0xc4202b85a0, 0xc4202b8660, 0xc42067e600)
Oct 27 04:56:08 nomad[6207]: #011/build/nomad-0.7.0/src/github.com/hashicorp/nomad/vendor/github.com/hashicorp/consul-template/watch/view.go:210 +0x147
Oct 27 04:56:08 nomad[6207]: created by github.com/hashicorp/nomad/vendor/github.com/hashicorp/consul-template/watch.(*View).poll
Oct 27 04:56:08 nomad[6207]: #011/build/nomad-0.7.0/src/github.com/hashicorp/nomad/vendor/github.com/hashicorp/consul-template/watch/view.go:125 +0x516
Oct 27 04:56:08 nomad[6207]: goroutine 664657 [select, 1865 minutes]:
Oct 27 04:56:08 nomad[6207]: github.com/hashicorp/nomad/client.(*TaskRunner).run(0xc4201eb520)
Oct 27 04:56:08 nomad[6207]: #011/build/nomad-0.7.0/src/github.com/hashicorp/nomad/client/task_runner.go:1098 +0x2cc
Oct 27 04:56:08 nomad[6207]: github.com/hashicorp/nomad/client.(*TaskRunner).Run(0xc4201eb520)
Oct 27 04:56:08 nomad[6207]: #011/build/nomad-0.7.0/src/github.com/hashicorp/nomad/client/task_runner.go:622 +0x509
Oct 27 04:56:08 nomad[6207]: created by github.com/hashicorp/nomad/client.(*AllocRunner).Run
Oct 27 04:56:08 nomad[6207]: #011/build/nomad-0.7.0/src/github.com/hashicorp/nomad/client/alloc_runner.go:812 +0x89c
Oct 27 04:56:08 nomad[6207]: goroutine 664144 [select, 1869 minutes]:
Oct 27 04:56:08 nomad[6207]: github.com/hashicorp/nomad/client.(*AllocRunner).dirtySyncState(0xc4209a4c60)
Oct 27 04:56:08 nomad[6207]: #011/build/nomad-0.7.0/src/github.com/hashicorp/nomad/client/alloc_runner.go:576 +0xfe
Oct 27 04:56:08 nomad[6207]: created by github.com/hashicorp/nomad/client.(*AllocRunner).Run
Oct 27 04:56:08 nomad[6207]: #011/build/nomad-0.7.0/src/github.com/hashicorp/nomad/client/alloc_runner.go:736 +0x8b
Oct 27 04:56:08 nomad[6207]: goroutine 663762 [select, 1872 minutes]:
Oct 27 04:56:08 nomad[6207]: github.com/hashicorp/nomad/vendor/github.com/hashicorp/consul-template/dependency.(*VaultReadQuery).Fetch(0xc4201d5560, 0xc420947a10, 0xc4206c9c20, 0x0, 0x0, 0x0, 0x0, 0x0)
Oct 27 04:56:08 nomad[6207]: #011/build/nomad-0.7.0/src/github.com/hashicorp/nomad/vendor/github.com/hashicorp/consul-template/dependency/vault_read.go:89 +0xacb
Oct 27 04:56:08 nomad[6207]: github.com/hashicorp/nomad/vendor/github.com/hashicorp/consul-template/watch.(*View).fetch(0xc420b38d80, 0xc4207a7f20, 0xc4207a7f80, 0xc420614060)
Oct 27 04:56:08 nomad[6207]: #011/build/nomad-0.7.0/src/github.com/hashicorp/nomad/vendor/github.com/hashicorp/consul-template/watch/view.go:210 +0x147
Oct 27 04:56:08 nomad[6207]: created by github.com/hashicorp/nomad/vendor/github.com/hashicorp/consul-template/watch.(*View).poll
Oct 27 04:56:08 nomad[6207]: #011/build/nomad-0.7.0/src/github.com/hashicorp/nomad/vendor/github.com/hashicorp/consul-template/watch/view.go:125 +0x516
Oct 27 04:56:08 nomad[6207]: goroutine 664771 [IO wait]:
Oct 27 04:56:08 nomad[6207]: internal/poll.runtime_pollWait(0x7f05e6ce15b0, 0x72, 0x0)
Oct 27 04:56:08 nomad[6207]: #011/usr/local/go/src/runtime/netpoll.go:173 +0x57
Oct 27 04:56:08 nomad[6207]: internal/poll.(*pollDesc).wait(0xc420662118, 0x72, 0xffffffffffffff00, 0x1fc0ac0, 0x1fb92d8)
Oct 27 04:56:08 nomad[6207]: #011/usr/local/go/src/internal/poll/fd_poll_runtime.go:85 +0xae
Oct 27 04:56:08 nomad[6207]: internal/poll.(*pollDesc).waitRead(0xc420662118, 0xc420ab8000, 0x1000, 0x1000)
Oct 27 04:56:08 nomad[6207]: #011/usr/local/go/src/internal/poll/fd_poll_runtime.go:90 +0x3d
Oct 27 04:56:08 nomad[6207]: internal/poll.(*FD).Read(0xc420662100, 0xc420ab8000, 0x1000, 0x1000, 0x0, 0x0, 0x0)
Oct 27 04:56:08 nomad[6207]: #011/usr/local/go/src/internal/poll/fd_unix.go:125 +0x18a
Oct 27 04:56:08 nomad[6207]: net.(*netFD).Read(0xc420662100, 0xc420ab8000, 0x1000, 0x1000, 0xc42053a2c0, 0x0, 0x0)
Oct 27 04:56:08 nomad[6207]: #011/usr/local/go/src/net/fd_unix.go:202 +0x52
Oct 27 04:56:08 nomad[6207]: net.(*conn).Read(0xc42000e7f0, 0xc420ab8000, 0x1000, 0x1000, 0x0, 0x0, 0x0)
Oct 27 04:56:08 nomad[6207]: #011/usr/local/go/src/net/net.go:176 +0x6d
Oct 27 04:56:08 nomad[6207]: bufio.(*Reader).Read(0xc420170360, 0xc4208985e0, 0xc, 0xc, 0xc4204e1e30, 0x7f05e6ca4ab0, 0x0)
Oct 27 04:56:08 nomad[6207]: #011/usr/local/go/src/bufio/bufio.go:213 +0x30b
Oct 27 04:56:08 nomad[6207]: io.ReadAtLeast(0x1fbaec0, 0xc420170360, 0xc4208985e0, 0xc, 0xc, 0xc, 0xc, 0x0, 0x0)
Oct 27 04:56:08 nomad[6207]: #011/usr/local/go/src/io/io.go:309 +0x86
Oct 27 04:56:08 nomad[6207]: io.ReadFull(0x1fbaec0, 0xc420170360, 0xc4208985e0, 0xc, 0xc, 0xc, 0x0, 0x0)
Oct 27 04:56:08 nomad[6207]: #011/usr/local/go/src/io/io.go:327 +0x58
Oct 27 04:56:08 nomad[6207]: github.com/hashicorp/nomad/vendor/github.com/hashicorp/yamux.(*Session).recvLoop(0xc420b88f20, 0x0, 0x0)
Oct 27 04:56:08 nomad[6207]: #011/build/nomad-0.7.0/src/github.com/hashicorp/nomad/vendor/github.com/hashicorp/yamux/session.go:418 +0xfc
Oct 27 04:56:08 nomad[6207]: github.com/hashicorp/nomad/vendor/github.com/hashicorp/yamux.(*Session).recv(0xc420b88f20)
Oct 27 04:56:08 nomad[6207]: #011/build/nomad-0.7.0/src/github.com/hashicorp/nomad/vendor/github.com/hashicorp/yamux/session.go:406 +0x2b
Oct 27 04:56:08 nomad[6207]: created by github.com/hashicorp/nomad/vendor/github.com/hashicorp/yamux.newSession
Oct 27 04:56:08 nomad[6207]: #011/build/nomad-0.7.0/src/github.com/hashicorp/nomad/vendor/github.com/hashicorp/yamux/session.go:108 +0x3e4
Oct 27 04:56:08 nomad[6207]: goroutine 663766 [select]:
Oct 27 04:56:08 nomad[6207]: github.com/hashicorp/nomad/vendor/github.com/hashicorp/yamux.(*Session).send(0xc4201ff550)
Oct 27 04:56:08 nomad[6207]: #011/build/nomad-0.7.0/src/github.com/hashicorp/nomad/vendor/github.com/hashicorp/yamux/session.go:368 +0x2ca
Oct 27 04:56:08 nomad[6207]: created by github.com/hashicorp/nomad/vendor/github.com/hashicorp/yamux.newSession
Oct 27 04:56:08 nomad[6207]: #011/build/nomad-0.7.0/src/github.com/hashicorp/nomad/vendor/github.com/hashicorp/yamux/session.go:109 +0x406
Oct 27 04:56:08 nomad[6207]: goroutine 663770 [select, 1872 minutes]:
Oct 27 04:56:08 nomad[6207]: github.com/hashicorp/nomad/vendor/github.com/hashicorp/yamux.(*Stream).Read(0xc4209f49c0, 0xc4208d4000, 0x2000, 0x2000, 0x0, 0x0, 0x0)
Oct 27 04:56:08 nomad[6207]: #011/build/nomad-0.7.0/src/github.com/hashicorp/nomad/vendor/github.com/hashicorp/yamux/stream.go:125 +0x270
Oct 27 04:56:08 nomad[6207]: io/ioutil.devNull.ReadFrom(0x0, 0x1fbca80, 0xc4209f49c0, 0x13bb780, 0xc420529701, 0x7f05e6cadcb8)
Oct 27 04:56:08 nomad[6207]: #011/usr/local/go/src/io/ioutil/ioutil.go:144 +0x92
Oct 27 04:56:08 nomad[6207]: io/ioutil.(*devNull).ReadFrom(0x2033530, 0x1fbca80, 0xc4209f49c0, 0x7f05e6cadcb8, 0x2033530, 0x1)
Oct 27 04:56:08 nomad[6207]: #011<autogenerated>:1 +0x50
Oct 27 04:56:08 nomad[6207]: io.copyBuffer(0x1fbfe40, 0x2033530, 0x1fbca80, 0xc4209f49c0, 0x0, 0x0, 0x0, 0xc400000008, 0xc4207b62c0, 0x413018)
Oct 27 04:56:08 nomad[6207]: #011/usr/local/go/src/io/io.go:386 +0x2bb
Oct 27 04:56:08 nomad[6207]: io.Copy(0x1fbfe40, 0x2033530, 0x1fbca80, 0xc4209f49c0, 0xc420740000, 0x15fa3a8, 0xc420740120)
Oct 27 04:56:08 nomad[6207]: #011/usr/local/go/src/io/io.go:362 +0x68
Oct 27 04:56:08 nomad[6207]: github.com/hashicorp/nomad/vendor/github.com/hashicorp/go-plugin.copyStream(0x1590bdf, 0x6, 0x1fbfe40, 0x2033530, 0x1fbca80, 0xc4209f49c0)
Oct 27 04:56:08 nomad[6207]: #011/build/nomad-0.7.0/src/github.com/hashicorp/nomad/vendor/github.com/hashicorp/go-plugin/stream.go:15 +0x79
Oct 27 04:56:08 nomad[6207]: created by github.com/hashicorp/nomad/vendor/github.com/hashicorp/go-plugin.(*RPCClient).SyncStreams
Oct 27 04:56:08 nomad[6207]: #011/build/nomad-0.7.0/src/github.com/hashicorp/nomad/vendor/github.com/hashicorp/go-plugin/rpc_client.go:108 +0x9d
Oct 27 04:56:08 nomad[6207]: goroutine 664113 [select, 1869 minutes]:
Oct 27 04:56:08 nomad[6207]: github.com/hashicorp/nomad/client.(*TaskRunner).run(0xc420b264e0)
Oct 27 04:56:08 nomad[6207]: #011/build/nomad-0.7.0/src/github.com/hashicorp/nomad/client/task_runner.go:1098 +0x2cc
Oct 27 04:56:08 nomad[6207]: github.com/hashicorp/nomad/client.(*TaskRunner).Run(0xc420b264e0)
Oct 27 04:56:08 nomad[6207]: #011/build/nomad-0.7.0/src/github.com/hashicorp/nomad/client/task_runner.go:622 +0x509
Oct 27 04:56:08 nomad[6207]: created by github.com/hashicorp/nomad/client.(*AllocRunner).Run
Oct 27 04:56:08 nomad[6207]: #011/build/nomad-0.7.0/src/github.com/hashicorp/nomad/client/alloc_runner.go:812 +0x89c
Oct 27 04:56:08 nomad[6207]: goroutine 664775 [select, 1865 minutes]:
Oct 27 04:56:08 nomad[6207]: github.com/hashicorp/nomad/vendor/github.com/hashicorp/yamux.(*Stream).Read(0xc4203d6dd0, 0xc420abc000, 0x1000, 0x1000, 0x0, 0x0, 0x0)
Oct 27 04:56:08 nomad[6207]: #011/build/nomad-0.7.0/src/github.com/hashicorp/nomad/vendor/github.com/hashicorp/yamux/stream.go:125 +0x270
Oct 27 04:56:08 nomad[6207]: bufio.(*Reader).Read(0xc420170f60, 0xc420898630, 0x1, 0x9, 0xc42091fca8, 0x42ca58, 0x3)
Oct 27 04:56:08 nomad[6207]: #011/usr/local/go/src/bufio/bufio.go:213 +0x30b
Oct 27 04:56:08 nomad[6207]: io.ReadAtLeast(0x1fbaec0, 0xc420170f60, 0xc420898630, 0x1, 0x9, 0x1, 0xc42001b300, 0x15f6080, 0xc420b446c0)
Oct 27 04:56:08 nomad[6207]: #011/usr/local/go/src/io/io.go:309 +0x86
Oct 27 04:56:08 nomad[6207]: io.ReadFull(0x1fbaec0, 0xc420170f60, 0xc420898630, 0x1, 0x9, 0xc42091fd10, 0x40629b, 0x3)
Oct 27 04:56:08 nomad[6207]: #011/usr/local/go/src/io/io.go:327 +0x58
Oct 27 04:56:08 nomad[6207]: encoding/gob.decodeUintReader(0x1fbaec0, 0xc420170f60, 0xc420898630, 0x9, 0x9, 0xc42091fd88, 0x42c399, 0xc400000008, 0xc420798740)
Oct 27 04:56:08 nomad[6207]: #011/usr/local/go/src/encoding/gob/decode.go:120 +0x63
Oct 27 04:56:08 nomad[6207]: encoding/gob.(*Decoder).recvMessage(0xc420662500, 0xc42091fda0)
Oct 27 04:56:08 nomad[6207]: #011/usr/local/go/src/encoding/gob/decoder.go:80 +0x57
Oct 27 04:56:08 nomad[6207]: encoding/gob.(*Decoder).decodeTypeSequence(0xc420662500, 0x15fa300, 0xc420662500)
Oct 27 04:56:08 nomad[6207]: #011/usr/local/go/src/encoding/gob/decoder.go:144 +0x14c
Oct 27 04:56:08 nomad[6207]: encoding/gob.(*Decoder).DecodeValue(0xc420662500, 0x12cde80, 0xc420946990, 0x16, 0x0, 0x0)
Oct 27 04:56:08 nomad[6207]: #011/usr/local/go/src/encoding/gob/decoder.go:212 +0xe6
Oct 27 04:56:08 nomad[6207]: encoding/gob.(*Decoder).Decode(0xc420662500, 0x12cde80, 0xc420946990, 0x0, 0x0)
Oct 27 04:56:08 nomad[6207]: #011/usr/local/go/src/encoding/gob/decoder.go:189 +0x16d
Oct 27 04:56:08 nomad[6207]: net/rpc.(*gobClientCodec).ReadResponseHeader(0xc420946900, 0xc420946990, 0xc42089863c, 0x0)
Oct 27 04:56:08 nomad[6207]: #011/usr/local/go/src/net/rpc/client.go:223 +0x45
Oct 27 04:56:08 nomad[6207]: net/rpc.(*Client).input(0xc420171080)
Oct 27 04:56:08 nomad[6207]: #011/usr/local/go/src/net/rpc/client.go:109 +0xb5
Oct 27 04:56:08 nomad[6207]: created by net/rpc.NewClientWithCodec
Oct 27 04:56:08 nomad[6207]: #011/usr/local/go/src/net/rpc/client.go:201 +0xc5
Oct 27 04:56:08 nomad[6207]: goroutine 664284 [select, 1869 minutes]:
Oct 27 04:56:08 nomad[6207]: github.com/hashicorp/nomad/vendor/github.com/hashicorp/yamux.(*Stream).Read(0xc420518d00, 0xc420592000, 0x2000, 0x2000, 0x0, 0x0, 0x0)
Oct 27 04:56:08 nomad[6207]: #011/build/nomad-0.7.0/src/github.com/hashicorp/nomad/vendor/github.com/hashicorp/yamux/stream.go:125 +0x270
Oct 27 04:56:08 nomad[6207]: io/ioutil.devNull.ReadFrom(0x0, 0x1fbca80, 0xc420518d00, 0x13bb780, 0x1, 0x7f05e6cadcb8)
Oct 27 04:56:08 nomad[6207]: #011/usr/local/go/src/io/ioutil/ioutil.go:144 +0x92
Oct 27 04:56:08 nomad[6207]: io/ioutil.(*devNull).ReadFrom(0x2033530, 0x1fbca80, 0xc420518d00, 0x7f05e6cadcb8, 0x2033530, 0x1)
Oct 27 04:56:08 nomad[6207]: #011<autogenerated>:1 +0x50
Oct 27 04:56:08 nomad[6207]: io.copyBuffer(0x1fbfe40, 0x2033530, 0x1fbca80, 0xc420518d00, 0x0, 0x0, 0x0, 0x0, 0x0, 0xc4206cf320)
Oct 27 04:56:08 nomad[6207]: #011/usr/local/go/src/io/io.go:386 +0x2bb
Oct 27 04:56:08 nomad[6207]: io.Copy(0x1fbfe40, 0x2033530, 0x1fbca80, 0xc420518d00, 0x0, 0x0, 0x0)
Oct 27 04:56:08 nomad[6207]: #011/usr/local/go/src/io/io.go:362 +0x68
Oct 27 04:56:08 nomad[6207]: github.com/hashicorp/nomad/vendor/github.com/hashicorp/go-plugin.copyStream(0x1590bdf, 0x6, 0x1fbfe40, 0x2033530, 0x1fbca80, 0xc420518d00)
Oct 27 04:56:08 nomad[6207]: #011/build/nomad-0.7.0/src/github.com/hashicorp/nomad/vendor/github.com/hashicorp/go-plugin/stream.go:15 +0x79
Oct 27 04:56:08 nomad[6207]: created by github.com/hashicorp/nomad/vendor/github.com/hashicorp/go-plugin.(*RPCClient).SyncStreams
Oct 27 04:56:08 nomad[6207]: #011/build/nomad-0.7.0/src/github.com/hashicorp/nomad/vendor/github.com/hashicorp/go-plugin/rpc_client.go:108 +0x9d
Oct 27 04:56:08 nomad[6207]: goroutine 664266 [select]:
Oct 27 04:56:08 nomad[6207]: github.com/hashicorp/nomad/client.(*TaskRunner).collectResourceUsageStats(0xc420b264e0, 0xc4209f9980)
Oct 27 04:56:08 nomad[6207]: #011/build/nomad-0.7.0/src/github.com/hashicorp/nomad/client/task_runner.go:1556 +0x129
Oct 27 04:56:08 nomad[6207]: created by github.com/hashicorp/nomad/client.(*TaskRunner).run
Oct 27 04:56:08 nomad[6207]: #011/build/nomad-0.7.0/src/github.com/hashicorp/nomad/client/task_runner.go:1126 +0x15de
Oct 27 04:56:08 nomad[6207]: goroutine 663696 [select, 1872 minutes]:
Oct 27 04:56:08 nomad[6207]: github.com/hashicorp/nomad/client.(*AllocRunner).Run(0xc4200791e0)
Oct 27 04:56:08 nomad[6207]: #011/build/nomad-0.7.0/src/github.com/hashicorp/nomad/client/alloc_runner.go:823 +0xa7c
Oct 27 04:56:08 nomad[6207]: created by github.com/hashicorp/nomad/client.(*Client).addAlloc
Oct 27 04:56:08 nomad[6207]: #011/build/nomad-0.7.0/src/github.com/hashicorp/nomad/client/client.go:1629 +0x48c
Oct 27 04:56:08 nomad[6207]: goroutine 848884 [select]:
Oct 27 04:56:08 nomad[6207]: net/http.(*persistConn).writeLoop(0xc42029fb00)
Oct 27 04:56:08 nomad[6207]: #011/usr/local/go/src/net/http/transport.go:1759 +0x165
Oct 27 04:56:08 nomad[6207]: created by net/http.(*Transport).dialConn
Oct 27 04:56:08 nomad[6207]: #011/usr/local/go/src/net/http/transport.go:1187 +0xa53
Oct 27 04:56:08 nomad[6207]: goroutine 663765 [IO wait]:
Oct 27 04:56:08 nomad[6207]: internal/poll.runtime_pollWait(0x7f05e6ce18b0, 0x72, 0x0)
Oct 27 04:56:08 nomad[6207]: #011/usr/local/go/src/runtime/netpoll.go:173 +0x57
Oct 27 04:56:08 nomad[6207]: internal/poll.(*pollDesc).wait(0xc420b39a98, 0x72, 0xffffffffffffff00, 0x1fc0ac0, 0x1fb92d8)
Oct 27 04:56:08 nomad[6207]: #011/usr/local/go/src/internal/poll/fd_poll_runtime.go:85 +0xae
Oct 27 04:56:08 nomad[6207]: internal/poll.(*pollDesc).waitRead(0xc420b39a98, 0xc420734000, 0x1000, 0x1000)
Oct 27 04:56:08 nomad[6207]: #011/usr/local/go/src/internal/poll/fd_poll_runtime.go:90 +0x3d
Oct 27 04:56:08 nomad[6207]: internal/poll.(*FD).Read(0xc420b39a80, 0xc420734000, 0x1000, 0x1000, 0x0, 0x0, 0x0)
Oct 27 04:56:08 nomad[6207]: #011/usr/local/go/src/internal/poll/fd_unix.go:125 +0x18a
Oct 27 04:56:08 nomad[6207]: net.(*netFD).Read(0xc420b39a80, 0xc420734000, 0x1000, 0x1000, 0xc42092fd00, 0x0, 0x0)
Oct 27 04:56:08 nomad[6207]: #011/usr/local/go/src/net/fd_unix.go:202 +0x52
Oct 27 04:56:08 nomad[6207]: net.(*conn).Read(0xc420312620, 0xc420734000, 0x1000, 0x1000, 0x0, 0x0, 0x0)
Oct 27 04:56:08 nomad[6207]: #011/usr/local/go/src/net/net.go:176 +0x6d
Oct 27 04:56:08 nomad[6207]: bufio.(*Reader).Read(0xc420614360, 0xc420014d40, 0xc, 0xc, 0xc420381390, 0x7f05e6ce8bb0, 0x0)
Oct 27 04:56:08 nomad[6207]: #011/usr/local/go/src/bufio/bufio.go:213 +0x30b
Oct 27 04:56:08 nomad[6207]: io.ReadAtLeast(0x1fbaec0, 0xc420614360, 0xc420014d40, 0xc, 0xc, 0xc, 0xc, 0x0, 0x0)
Oct 27 04:56:08 nomad[6207]: #011/usr/local/go/src/io/io.go:309 +0x86
Oct 27 04:56:08 nomad[6207]: io.ReadFull(0x1fbaec0, 0xc420614360, 0xc420014d40, 0xc, 0xc, 0xc, 0x0, 0x0)
Oct 27 04:56:08 nomad[6207]: #011/usr/local/go/src/io/io.go:327 +0x58
Oct 27 04:56:08 nomad[6207]: github.com/hashicorp/nomad/vendor/github.com/hashicorp/yamux.(*Session).recvLoop(0xc4201ff550, 0x0, 0x0)
Oct 27 04:56:08 nomad[6207]: #011/build/nomad-0.7.0/src/github.com/hashicorp/nomad/vendor/github.com/hashicorp/yamux/session.go:418 +0xfc
Oct 27 04:56:08 nomad[6207]: github.com/hashicorp/nomad/vendor/github.com/hashicorp/yamux.(*Session).recv(0xc4201ff550)
Oct 27 04:56:08 nomad[6207]: #011/build/nomad-0.7.0/src/github.com/hashicorp/nomad/vendor/github.com/hashicorp/yamux/session.go:406 +0x2b
Oct 27 04:56:08 nomad[6207]: created by github.com/hashicorp/nomad/vendor/github.com/hashicorp/yamux.newSession
Oct 27 04:56:08 nomad[6207]: #011/build/nomad-0.7.0/src/github.com/hashicorp/nomad/vendor/github.com/hashicorp/yamux/session.go:108 +0x3e4
Oct 27 04:56:08 nomad[6207]: goroutine 664262 [select]:
Oct 27 04:56:08 nomad[6207]: github.com/hashicorp/nomad/vendor/github.com/hashicorp/yamux.(*Stream).Read(0xc420518f70, 0xc420731000, 0x1000, 0x1000, 0x0, 0x0, 0x0)
Oct 27 04:56:08 nomad[6207]: #011/build/nomad-0.7.0/src/github.com/hashicorp/nomad/vendor/github.com/hashicorp/yamux/stream.go:125 +0x270
Oct 27 04:56:08 nomad[6207]: bufio.(*Reader).Read(0xc420a65620, 0xc420014b50, 0x1, 0x9, 0xc420617ca8, 0x42ca58, 0x15f6080)
Oct 27 04:56:08 nomad[6207]: #011/usr/local/go/src/bufio/bufio.go:213 +0x30b
Oct 27 04:56:08 nomad[6207]: io.ReadAtLeast(0x1fbaec0, 0xc420a65620, 0xc420014b50, 0x1, 0x9, 0x1, 0xc42001a000, 0xc42053a290, 0x195)
Oct 27 04:56:08 nomad[6207]: #011/usr/local/go/src/io/io.go:309 +0x86
Oct 27 04:56:08 nomad[6207]: io.ReadFull(0x1fbaec0, 0xc420a65620, 0xc420014b50, 0x1, 0x9, 0xc420617d10, 0x40629b, 0x3)
Oct 27 04:56:08 nomad[6207]: #011/usr/local/go/src/io/io.go:327 +0x58
Oct 27 04:56:08 nomad[6207]: encoding/gob.decodeUintReader(0x1fbaec0, 0xc420a65620, 0xc420014b50, 0x9, 0x9, 0xc420617d88, 0x42c399, 0xc400000008, 0xc42082e9c0)
Oct 27 04:56:08 nomad[6207]: #011/usr/local/go/src/encoding/gob/decode.go:120 +0x63
Oct 27 04:56:08 nomad[6207]: encoding/gob.(*Decoder).recvMessage(0xc420416800, 0xc420617da0)
Oct 27 04:56:08 nomad[6207]: #011/usr/local/go/src/encoding/gob/decoder.go:80 +0x57
Oct 27 04:56:08 nomad[6207]: encoding/gob.(*Decoder).decodeTypeSequence(0xc420416800, 0x15fa300, 0xc420416800)
Oct 27 04:56:08 nomad[6207]: #011/usr/local/go/src/encoding/gob/decoder.go:144 +0x14c
Oct 27 04:56:08 nomad[6207]: encoding/gob.(*Decoder).DecodeValue(0xc420416800, 0x12cde80, 0xc4206a6bd0, 0x16, 0x0, 0x0)
Oct 27 04:56:08 nomad[6207]: #011/usr/local/go/src/encoding/gob/decoder.go:212 +0xe6
Oct 27 04:56:08 nomad[6207]: encoding/gob.(*Decoder).Decode(0xc420416800, 0x12cde80, 0xc4206a6bd0, 0x0, 0x0)
Oct 27 04:56:08 nomad[6207]: #011/usr/local/go/src/encoding/gob/decoder.go:189 +0x16d
Oct 27 04:56:08 nomad[6207]: net/rpc.(*gobClientCodec).ReadResponseHeader(0xc4206a65a0, 0xc4206a6bd0, 0xc42053a280, 0x0)
Oct 27 04:56:08 nomad[6207]: #011/usr/local/go/src/net/rpc/client.go:223 +0x45
Oct 27 04:56:08 nomad[6207]: net/rpc.(*Client).input(0xc420a656e0)
Oct 27 04:56:08 nomad[6207]: #011/usr/local/go/src/net/rpc/client.go:109 +0xb5
Oct 27 04:56:08 nomad[6207]: created by net/rpc.NewClientWithCodec
Oct 27 04:56:08 nomad[6207]: #011/usr/local/go/src/net/rpc/client.go:201 +0xc5
Oct 27 04:56:08 nomad[6207]: goroutine 664720 [IO wait, 1865 minutes]:
Oct 27 04:56:08 nomad[6207]: internal/poll.runtime_pollWait(0x7f05e6ce1430, 0x72, 0x1)
Oct 27 04:56:08 nomad[6207]: #011/usr/local/go/src/runtime/netpoll.go:173 +0x57
Oct 27 04:56:08 nomad[6207]: internal/poll.(*pollDesc).wait(0xc42013cd88, 0x72, 0xffffffffffffff01, 0x1fc0ac0, 0x1fb92d8)
Oct 27 04:56:08 nomad[6207]: #011/usr/local/go/src/internal/poll/fd_poll_runtime.go:85 +0xae
Oct 27 04:56:08 nomad[6207]: internal/poll.(*pollDesc).waitRead(0xc42013cd88, 0xc420aa8001, 0x8000, 0x8000)
Oct 27 04:56:08 nomad[6207]: #011/usr/local/go/src/internal/poll/fd_poll_runtime.go:90 +0x3d
Oct 27 04:56:08 nomad[6207]: internal/poll.(*FD).Read(0xc42013cd70, 0xc420aa8000, 0x8000, 0x8000, 0x0, 0x0, 0x0)
Oct 27 04:56:08 nomad[6207]: #011/usr/local/go/src/internal/poll/fd_unix.go:125 +0x18a
Oct 27 04:56:08 nomad[6207]: os.(*File).read(0xc4201c5250, 0xc420aa8000, 0x8000, 0x8000, 0xc4203e7660, 0x46adcc, 0xc4200eb5c0)
Oct 27 04:56:08 nomad[6207]: #011/usr/local/go/src/os/file_unix.go:216 +0x4e
Oct 27 04:56:08 nomad[6207]: os.(*File).Read(0xc4201c5250, 0xc420aa8000, 0x8000, 0x8000, 0x25, 0x0, 0x0)
Oct 27 04:56:08 nomad[6207]: #011/usr/local/go/src/os/file.go:103 +0x6d
Oct 27 04:56:08 nomad[6207]: io.copyBuffer(0x1fbd800, 0xc4201c5230, 0x1fbe480, 0xc4201c5250, 0xc420aa8000, 0x8000, 0x8000, 0xc42030b800, 0xc4207b67c0, 0x15fa3a8)
Oct 27 04:56:08 nomad[6207]: #011/usr/local/go/src/io/io.go:392 +0x123
Oct 27 04:56:08 nomad[6207]: io.Copy(0x1fbd800, 0xc4201c5230, 0x1fbe480, 0xc4201c5250, 0xc4203e77b0, 0x15f93e8, 0xc4203e77b0)
Oct 27 04:56:08 nomad[6207]: #011/usr/local/go/src/io/io.go:362 +0x68
Oct 27 04:56:08 nomad[6207]: os/exec.(*Cmd).writerDescriptor.func1(0x15fa0f8, 0x0)
Oct 27 04:56:08 nomad[6207]: #011/usr/local/go/src/os/exec/exec.go:264 +0x4d
Oct 27 04:56:08 nomad[6207]: os/exec.(*Cmd).Start.func1(0xc4202c9340, 0xc420150a40)
Oct 27 04:56:08 nomad[6207]: #011/usr/local/go/src/os/exec/exec.go:380 +0x27
Oct 27 04:56:08 nomad[6207]: created by os/exec.(*Cmd).Start
Oct 27 04:56:08 nomad[6207]: #011/usr/local/go/src/os/exec/exec.go:379 +0x646
Oct 27 04:56:08 nomad[6207]: goroutine 664779 [chan receive, 1865 minutes]:
Oct 27 04:56:08 nomad[6207]: net/rpc.(*Client).Call(0xc420171800, 0x1596c55, 0xb, 0x12b4e40, 0xc4202d1630, 0x12a1740, 0xc4208f8280, 0x0, 0x0)
Oct 27 04:56:08 nomad[6207]: #011/usr/local/go/src/net/rpc/client.go:317 +0xbc
Oct 27 04:56:08 nomad[6207]: github.com/hashicorp/nomad/client/driver.(*ExecutorRPC).Wait(0xc4203a3eb0, 0x72300d, 0x1, 0x0)
Oct 27 04:56:08 nomad[6207]: #011/build/nomad-0.7.0/src/github.com/hashicorp/nomad/client/driver/executor_plugin.go:62 +0x9d
Oct 27 04:56:08 nomad[6207]: github.com/hashicorp/nomad/client/driver.(*execHandle).run(0xc42022b420)
Oct 27 04:56:08 nomad[6207]: #011/build/nomad-0.7.0/src/github.com/hashicorp/nomad/client/driver/exec.go:293 +0x49
Oct 27 04:56:08 nomad[6207]: created by github.com/hashicorp/nomad/client/driver.(*ExecDriver).Start
Oct 27 04:56:08 nomad[6207]: #011/build/nomad-0.7.0/src/github.com/hashicorp/nomad/client/driver/exec.go:163 +0x6bc
Oct 27 04:56:08 nomad[6207]: goroutine 664275 [syscall, 1869 minutes]:
Oct 27 04:56:08 nomad[6207]: syscall.Syscall6(0xf7, 0x1, 0x1666, 0xc420526d78, 0x1000004, 0x0, 0x0, 0xc420526de8, 0x42ca58, 0xc4209fa240)
Oct 27 04:56:08 nomad[6207]: #011/usr/local/go/src/syscall/asm_linux_amd64.s:44 +0x5
Oct 27 04:56:08 nomad[6207]: os.(*Process).blockUntilWaitable(0xc420749860, 0x50, 0x50, 0x14950c0)
Oct 27 04:56:08 nomad[6207]: #011/usr/local/go/src/os/wait_waitid.go:31 +0xa5
Oct 27 04:56:08 nomad[6207]: os.(*Process).wait(0xc420749860, 0x6, 0xc4209a0780, 0xc4201bf590)
Oct 27 04:56:08 nomad[6207]: #011/usr/local/go/src/os/exec_unix.go:22 +0x42
Oct 27 04:56:08 nomad[6207]: os.(*Process).Wait(0xc420749860, 0xc420526f58, 0x440cd2, 0xc420539c20)
Oct 27 04:56:08 nomad[6207]: #011/usr/local/go/src/os/exec.go:115 +0x2b
Oct 27 04:56:08 nomad[6207]: os/exec.(*Cmd).Wait(0xc4200f2580, 0x15f9950, 0xc4201c40b8)
Oct 27 04:56:08 nomad[6207]: #011/usr/local/go/src/os/exec/exec.go:446 +0x62
Oct 27 04:56:08 nomad[6207]: github.com/hashicorp/nomad/vendor/github.com/hashicorp/go-plugin.(*Client).Start.func3(0xc4201c40e0, 0xc4201c40b8, 0xc4200f2580, 0xc4204782a0, 0xc4202b9380)
Oct 27 04:56:08 nomad[6207]: #011/build/nomad-0.7.0/src/github.com/hashicorp/nomad/vendor/github.com/hashicorp/go-plugin/client.go:529 +0x83
Oct 27 04:56:08 nomad[6207]: created by github.com/hashicorp/nomad/vendor/github.com/hashicorp/go-plugin.(*Client).Start
Oct 27 04:56:08 nomad[6207]: #011/build/nomad-0.7.0/src/github.com/hashicorp/nomad/vendor/github.com/hashicorp/go-plugin/client.go:522 +0xd26
Oct 27 04:56:08 nomad[6207]: goroutine 664283 [select, 1869 minutes]:
Oct 27 04:56:08 nomad[6207]: github.com/hashicorp/nomad/vendor/github.com/hashicorp/yamux.(*Stream).Read(0xc420518c30, 0xc420746000, 0x1000, 0x1000, 0x0, 0x0, 0x0)
Oct 27 04:56:08 nomad[6207]: #011/build/nomad-0.7.0/src/github.com/hashicorp/nomad/vendor/github.com/hashicorp/yamux/stream.go:125 +0x270
Oct 27 04:56:08 nomad[6207]: bufio.(*Reader).Read(0xc42067f020, 0xc4204f78c0, 0x1, 0x9, 0xc420a15ca8, 0x42ca58, 0x3)
Oct 27 04:56:08 nomad[6207]: #011/usr/local/go/src/bufio/bufio.go:213 +0x30b
Oct 27 04:56:08 nomad[6207]: io.ReadAtLeast(0x1fbaec0, 0xc42067f020, 0xc4204f78c0, 0x1, 0x9, 0x1, 0xc42001c600, 0x15f6080, 0xc4208f82c0)
Oct 27 04:56:08 nomad[6207]: #011/usr/local/go/src/io/io.go:309 +0x86
Oct 27 04:56:08 nomad[6207]: io.ReadFull(0x1fbaec0, 0xc42067f020, 0xc4204f78c0, 0x1, 0x9, 0xc420a15d10, 0x40629b, 0x3)
Oct 27 04:56:08 nomad[6207]: #011/usr/local/go/src/io/io.go:327 +0x58
Oct 27 04:56:08 nomad[6207]: encoding/gob.decodeUintReader(0x1fbaec0, 0xc42067f020, 0xc4204f78c0, 0x9, 0x9, 0xc420a15d88, 0x42c399, 0xc400000008, 0xc420b3d080)
Oct 27 04:56:08 nomad[6207]: #011/usr/local/go/src/encoding/gob/decode.go:120 +0x63
Oct 27 04:56:08 nomad[6207]: encoding/gob.(*Decoder).recvMessage(0xc420662780, 0xc420a15da0)
Oct 27 04:56:08 nomad[6207]: #011/usr/local/go/src/encoding/gob/decoder.go:80 +0x57
Oct 27 04:56:08 nomad[6207]: encoding/gob.(*Decoder).decodeTypeSequence(0xc420662780, 0x15fa300, 0xc420662780)
Oct 27 04:56:08 nomad[6207]: #011/usr/local/go/src/encoding/gob/decoder.go:144 +0x14c
Oct 27 04:56:08 nomad[6207]: encoding/gob.(*Decoder).DecodeValue(0xc420662780, 0x12cde80, 0xc42059cab0, 0x16, 0x0, 0x0)
Oct 27 04:56:08 nomad[6207]: #011/usr/local/go/src/encoding/gob/decoder.go:212 +0xe6
Oct 27 04:56:08 nomad[6207]: encoding/gob.(*Decoder).Decode(0xc420662780, 0x12cde80, 0xc42059cab0, 0x0, 0x0)
Oct 27 04:56:08 nomad[6207]: #011/usr/local/go/src/encoding/gob/decoder.go:189 +0x16d
Oct 27 04:56:08 nomad[6207]: net/rpc.(*gobClientCodec).ReadResponseHeader(0xc42059ca20, 0xc42059cab0, 0xc4204f774c, 0x0)
Oct 27 04:56:08 nomad[6207]: #011/usr/local/go/src/net/rpc/client.go:223 +0x45
Oct 27 04:56:08 nomad[6207]: net/rpc.(*Client).input(0xc42067f200)
Oct 27 04:56:08 nomad[6207]: #011/usr/local/go/src/net/rpc/client.go:109 +0xb5
Oct 27 04:56:08 nomad[6207]: created by net/rpc.NewClientWithCodec
Oct 27 04:56:08 nomad[6207]: #011/usr/local/go/src/net/rpc/client.go:201 +0xc5
Oct 27 04:56:08 nomad[6207]: goroutine 664162 [select, 1869 minutes]:
Oct 27 04:56:08 nomad[6207]: github.com/hashicorp/nomad/client.(*TaskRunner).vaultManager(0xc420b264e0, 0xc42079fe90, 0x24)
Oct 27 04:56:08 nomad[6207]: #011/build/nomad-0.7.0/src/github.com/hashicorp/nomad/client/task_runner.go:827 +0x335
Oct 27 04:56:08 nomad[6207]: created by github.com/hashicorp/nomad/client.(*TaskRunner).Run
Oct 27 04:56:08 nomad[6207]: #011/build/nomad-0.7.0/src/github.com/hashicorp/nomad/client/task_runner.go:618 +0x57d
Oct 27 04:56:08 nomad[6207]: goroutine 663779 [IO wait, 1872 minutes]:
Oct 27 04:56:08 nomad[6207]: internal/poll.runtime_pollWait(0x7f05e6ce1a30, 0x72, 0x1)
Oct 27 04:56:08 nomad[6207]: #011/usr/local/go/src/runtime/netpoll.go:173 +0x57
Oct 27 04:56:08 nomad[6207]: internal/poll.(*pollDesc).wait(0xc4208b44c8, 0x72, 0xffffffffffffff01, 0x1fc0ac0, 0x1fb92d8)
Oct 27 04:56:08 nomad[6207]: #011/usr/local/go/src/internal/poll/fd_poll_runtime.go:85 +0xae
Oct 27 04:56:08 nomad[6207]: internal/poll.(*pollDesc).waitRead(0xc4208b44c8, 0xc4208c2001, 0x8000, 0x8000)
Oct 27 04:56:08 nomad[6207]: #011/usr/local/go/src/internal/poll/fd_poll_runtime.go:90 +0x3d
Oct 27 04:56:08 nomad[6207]: internal/poll.(*FD).Read(0xc4208b44b0, 0xc4208c2000, 0x8000, 0x8000, 0x0, 0x0, 0x0)
Oct 27 04:56:08 nomad[6207]: #011/usr/local/go/src/internal/poll/fd_unix.go:125 +0x18a
Oct 27 04:56:08 nomad[6207]: os.(*File).read(0xc4201c43b0, 0xc4208c2000, 0x8000, 0x8000, 0xc420022e60, 0x46adcc, 0xc4200eb2c0)
Oct 27 04:56:08 nomad[6207]: #011/usr/local/go/src/os/file_unix.go:216 +0x4e
Oct 27 04:56:08 nomad[6207]: os.(*File).Read(0xc4201c43b0, 0xc4208c2000, 0x8000, 0x8000, 0x25, 0x0, 0x0)
Oct 27 04:56:08 nomad[6207]: #011/usr/local/go/src/os/file.go:103 +0x6d
Oct 27 04:56:08 nomad[6207]: io.copyBuffer(0x1fbd800, 0xc4201c4358, 0x1fbe480, 0xc4201c43b0, 0xc4208c2000, 0x8000, 0x8000, 0xc4201d4ea0, 0xc4200f7180, 0x0)
Oct 27 04:56:08 nomad[6207]: #011/usr/local/go/src/io/io.go:392 +0x123
Oct 27 04:56:08 nomad[6207]: io.Copy(0x1fbd800, 0xc4201c4358, 0x1fbe480, 0xc4201c43b0, 0xc42073d2e0, 0xc4201749c0, 0xc4209fa9c0)
Oct 27 04:56:08 nomad[6207]: #011/usr/local/go/src/io/io.go:362 +0x68
Oct 27 04:56:08 nomad[6207]: os/exec.(*Cmd).writerDescriptor.func1(0xc420874000, 0xc4209e00a0)
Oct 27 04:56:08 nomad[6207]: #011/usr/local/go/src/os/exec/exec.go:264 +0x4d
Oct 27 04:56:08 nomad[6207]: os/exec.(*Cmd).Start.func1(0xc420078840, 0xc42036d220)
Oct 27 04:56:08 nomad[6207]: #011/usr/local/go/src/os/exec/exec.go:380 +0x27
Oct 27 04:56:08 nomad[6207]: created by os/exec.(*Cmd).Start
Oct 27 04:56:08 nomad[6207]: #011/usr/local/go/src/os/exec/exec.go:379 +0x646
Oct 27 04:56:08 systemd[1]: nomad-agent.service: Service hold-off time over, scheduling restart.
Oct 27 04:56:08 systemd[1]: Stopped Hashicorp nomad Agent.

[dadgar]

@joliver Thanks for the report. Will be fixed in 0.7.0

[github-actions]

I'm going to lock this issue because it has been closed for 120 days ⏳. This helps our maintainers find and focus on the active issues.
If you have found a problem that seems similar to this, please open a new issue and complete the issue template so we can capture all the details necessary to investigate further.