Pod information is left while assigning host networking with docker #652

GabyCT · 2018-08-27T14:44:32Z

While performing

$ docker run --runtime kata-runtime -d --net=host debian sh

A file is left at

$ ls /var/lib/vc/sbs/
d484711ec897f115e8708ce899781e8e7db1a7fbb616e7e2311c397922e7ba8a

And that is causing that the execution of the soak test fails.

Using the following setup:
kata-runtime : 1.2.0
commit : f70d6d2
OCI specs: 1.0.1
kata-agent version 1.2.0-4c723f49d590813c311dcd0e2aab19616d757f19
kata-proxy version 1.2.0-6f209b7f3c586c5f17b52df8bd5d6edbc45ee477
kata-shim version 1.2.0-0a37760c0224167143cb3cc920c78f5147f52e70

The text was updated successfully, but these errors were encountered:

jodh-intel · 2018-08-28T11:02:56Z

yay for the soak test! 😄

Do you see the same behaviour using the latest runtime commit? FTR, I don't but I'm using latest everything.

jodh-intel · 2018-08-28T11:03:06Z

/cc @grahamwhaley.

amshinde · 2018-08-28T17:31:10Z

@GabyCT Yeah same question as @jodh-intel, are you seeing the issue with the latest commit?
Let me know if you are, and I will take a look at this.

GabyCT · 2018-08-28T21:03:40Z

@amshinde and @jodh-intel , well I ran the ./setup.sh and I am using the latest commit of runtime

kata-runtime  : 1.2.0
commit   : a3038924fbf93bb59220ab9d33de667d29ffceab
OCI specs: 1.0.1

And the issue is still there

$ docker run --runtime kata-runtime -d --net=host debian sh
52f56da0d556c2af42250a4adacf41cc636c6c98398244e4ead3f960b503a7e2
docker: Error response from daemon: OCI runtime create failed: Host networking requested, not supported by runtime: unknown.
$ ls /var/lib/vc/sbs/
52f56da0d556c2af42250a4adacf41cc636c6c98398244e4ead3f960b503a7e2

jodh-intel · 2018-08-29T09:19:52Z

Hi @GabyCT - can you list the versions of proxy, shim and image/agent you are running too? Just paste in the output of sudo kata-collect-data.sh so we can see the full details.

GabyCT · 2018-08-29T15:01:05Z

@jodh-intel , here it is the information

# `kata-env`

Output of "`/usr/local/bin/kata-runtime kata-env`":

[Meta]
  Version = "1.0.15"

[Runtime]
  Debug = false
  Path = "/usr/local/bin/kata-runtime"
  [Runtime.Version]
    Semver = "1.2.0"
    Commit = "a3038924fbf93bb59220ab9d33de667d29ffceab"
    OCI = "1.0.1"
  [Runtime.Config]
    Path = "/usr/share/defaults/kata-containers/configuration.toml"

[Hypervisor]
  MachineType = "pc"
  Version = "QEMU emulator version 2.11.0\nCopyright (c) 2003-2017 Fabrice Bellard and the QEMU Project developers"
  Path = "/usr/bin/qemu-lite-system-x86_64"
  BlockDeviceDriver = "virtio-scsi"
  Msize9p = 8192
  Debug = false
  UseVSock = false

[Image]
  Path = "/usr/share/kata-containers/kata-containers-image_clearlinux_1.2.0_agent_fcfa054a757.img"

[Kernel]
  Path = "/usr/share/kata-containers/vmlinuz-4.14.51-10"
  Parameters = "agent.log=debug"

[Initrd]
  Path = ""

[Proxy]
  Type = "kataProxy"
  Version = "kata-proxy version 1.2.0-6f209b7f3c586c5f17b52df8bd5d6edbc45ee477"
  Path = "/usr/libexec/kata-containers/kata-proxy"
  Debug = true

[Shim]
  Type = "kataShim"
  Version = "kata-shim version 1.2.0-0a37760c0224167143cb3cc920c78f5147f52e70"
  Path = "/usr/libexec/kata-containers/kata-shim"
  Debug = true

[Agent]
  Type = "kata"

[Host]
  Kernel = "4.15.0-1021-azure"
  Architecture = "amd64"
  VMContainerCapable = true
  SupportVSocks = false
  [Host.Distro]
    Name = "Ubuntu"
    Version = "16.04"
  [Host.CPU]
    Vendor = "GenuineIntel"
    Model = "Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz"

GabyCT · 2018-08-29T15:04:12Z

it looks like the agent information was not generated, however, here it is

kata-agent version 1.2.0-4c723f49d590813c311dcd0e2aab19616d757f19

jodh-intel · 2018-08-29T15:24:51Z

You need to run sudo kata-collect-data.sh to get the agent info.

To save us time, please could you explain if you're using the packaged version of everything or you've built all the components, or a combination of both?

GabyCT · 2018-08-29T16:35:09Z

from what I can see the only thing that is not updated to latest is the agent, let me update it and test again

grahamwhaley · 2018-08-29T16:40:59Z

what sort of graph driver (storage) do you have on your docker - and what is your docker version. I have to wonder if the graph driver might make a difference to such things - we have quite different mounts and accesses which maybe prevent something being free'd up for instance.

GabyCT · 2018-08-29T16:45:39Z

@grahamwhaley here it is the info

Containers: 1
 Running: 0
 Paused: 0
 Stopped: 1
Images: 49
Server Version: 18.06.0-ce
Storage Driver: overlay2
 Backing Filesystem: extfs
 Supports d_type: true
 Native Overlay Diff: false
Logging Driver: json-file
Cgroup Driver: cgroupfs
Plugins:
 Volume: local
 Network: bridge host macvlan null overlay
 Log: awslogs fluentd gcplogs gelf journald json-file logentries splunk syslog
Swarm: inactive
Runtimes: kata-runtime runc
Default Runtime: kata-runtime
Init Binary: docker-init
containerd version: d64c661f1d51c48782c9cec8fda7604785f93587
runc version: a3038924fbf93bb59220ab9d33de667d29ffceab (expected: 69663f0bd4b60df09991c08812a60108003fa340)
init version: fec3683
Security Options:
 apparmor
 seccomp
  Profile: default
Kernel Version: 4.15.0-1021-azure
Operating System: Ubuntu 16.04.5 LTS
OSType: linux
Architecture: x86_64
CPUs: 4
Total Memory: 15.67GiB
Name: gabyubuntu
ID: XO5W:QTCU:VJ4Z:QJFW:E6Q6:XXQJ:ORD5:5SZN:6SVI:2NLV:5XOK:ULNC
Docker Root Dir: /var/lib/docker
Debug Mode (client): false
Debug Mode (server): true
 File Descriptors: 24
 Goroutines: 44
 System Time: 2018-08-29T16:44:45.477537654Z
 EventsListeners: 0
Registry: https://index.docker.io/v1/
Labels:
Experimental: false
Insecure Registries:
 127.0.0.0/8
Live Restore Enabled: false

WARNING: No swap limit support

GabyCT · 2018-08-29T16:52:18Z

Well, I updated the latest agent

$ sudo kata-agent --version
kata-agent version 1.2.0-cdc68ecac2ccc477ece979e768ab37222ed74d2a

and no luck. Here it is all the info of sudo kata-collect-data.sh

# Meta details

Running `kata-collect-data.sh` version `1.2.0 (commit a3038924fbf93bb59220ab9d33de667d29ffceab)` at `2018-08-29.16:47:31.209311177+0000`.

---

Runtime is `/usr/local/bin/kata-runtime`.

# `kata-env`

Output of "`/usr/local/bin/kata-runtime kata-env`":

[Meta]
  Version = "1.0.15"

[Runtime]
  Debug = false
  Path = "/usr/local/bin/kata-runtime"
  [Runtime.Version]
    Semver = "1.2.0"
    Commit = "a3038924fbf93bb59220ab9d33de667d29ffceab"
    OCI = "1.0.1"
  [Runtime.Config]
    Path = "/usr/share/defaults/kata-containers/configuration.toml"

[Hypervisor]
  MachineType = "pc"
  Version = "QEMU emulator version 2.11.0\nCopyright (c) 2003-2017 Fabrice Bellard and the QEMU Project developers"
  Path = "/usr/bin/qemu-lite-system-x86_64"
  BlockDeviceDriver = "virtio-scsi"
  Msize9p = 8192
  Debug = false
  UseVSock = false

[Image]
  Path = "/usr/share/kata-containers/kata-containers-image_clearlinux_1.2.0_agent_fcfa054a757.img"

[Kernel]
  Path = "/usr/share/kata-containers/vmlinuz-4.14.51-10"
  Parameters = "agent.log=debug"

[Initrd]
  Path = ""

[Proxy]
  Type = "kataProxy"
  Version = "kata-proxy version 1.2.0-6f209b7f3c586c5f17b52df8bd5d6edbc45ee477"
  Path = "/usr/libexec/kata-containers/kata-proxy"
  Debug = true

[Shim]
  Type = "kataShim"
  Version = "kata-shim version 1.2.0-0a37760c0224167143cb3cc920c78f5147f52e70"
  Path = "/usr/libexec/kata-containers/kata-shim"
  Debug = true

[Agent]
  Type = "kata"

[Host]
  Kernel = "4.15.0-1021-azure"
  Architecture = "amd64"
  VMContainerCapable = true
  SupportVSocks = false
  [Host.Distro]
    Name = "Ubuntu"
    Version = "16.04"
  [Host.CPU]
    Vendor = "GenuineIntel"
    Model = "Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz"

Runtime config files

Runtime default config files

/etc/kata-containers/configuration.toml
/usr/share/defaults/kata-containers/configuration.toml

Runtime config file contents

Config file /etc/kata-containers/configuration.toml not found
Output of "cat "/usr/share/defaults/kata-containers/configuration.toml"":

# Copyright (c) 2017-2018 Intel Corporation
#
# SPDX-License-Identifier: Apache-2.0
#

# XXX: WARNING: this file is auto-generated.
# XXX:
# XXX: Source file: "cli/config/configuration.toml.in"
# XXX: Project:
# XXX:   Name: Kata Containers
# XXX:   Type: kata

[hypervisor.qemu]
path = "/usr/bin/qemu-lite-system-x86_64"
kernel = "/usr/share/kata-containers/vmlinuz.container"
image = "/usr/share/kata-containers/kata-containers.img"
machine_type = "pc"

# Optional space-separated list of options to pass to the guest kernel.
# For example, use `kernel_params = "vsyscall=emulate"` if you are having
# trouble running pre-2.15 glibc.
#
# WARNING: - any parameter specified here will take priority over the default
# parameter value of the same name used to start the virtual machine.
# Do not set values here unless you understand the impact of doing so as you
# may stop the virtual machine from booting.
# To see the list of default parameters, enable hypervisor debug, create a
# container and look for 'default-kernel-parameters' log entries.
kernel_params = " agent.log=debug"

# Path to the firmware.
# If you want that qemu uses the default firmware leave this option empty
firmware = ""

# Machine accelerators
# comma-separated list of machine accelerators to pass to the hypervisor.
# For example, `machine_accelerators = "nosmm,nosmbus,nosata,nopit,static-prt,nofw"`
machine_accelerators=""

# Default number of vCPUs per SB/VM:
# unspecified or 0                --> will be set to 1
# < 0                             --> will be set to the actual number of physical cores
# > 0 <= number of physical cores --> will be set to the specified number
# > number of physical cores      --> will be set to the actual number of physical cores
default_vcpus = 1

# Default maximum number of vCPUs per SB/VM:
# unspecified or == 0             --> will be set to the actual number of physical cores or to the maximum number
#                                     of vCPUs supported by KVM if that number is exceeded
# > 0 <= number of physical cores --> will be set to the specified number
# > number of physical cores      --> will be set to the actual number of physical cores or to the maximum number
#                                     of vCPUs supported by KVM if that number is exceeded
# WARNING: Depending of the architecture, the maximum number of vCPUs supported by KVM is used when
# the actual number of physical cores is greater than it.
# WARNING: Be aware that this value impacts the virtual machine's memory footprint and CPU
# the hotplug functionality. For example, `default_maxvcpus = 240` specifies that until 240 vCPUs
# can be added to a SB/VM, but the memory footprint will be big. Another example, with
# `default_maxvcpus = 8` the memory footprint will be small, but 8 will be the maximum number of
# vCPUs supported by the SB/VM. In general, we recommend that you do not edit this variable,
# unless you know what are you doing.
default_maxvcpus = 0

# Bridges can be used to hot plug devices.
# Limitations:
# * Currently only pci bridges are supported
# * Until 30 devices per bridge can be hot plugged.
# * Until 5 PCI bridges can be cold plugged per VM.
#   This limitation could be a bug in qemu or in the kernel
# Default number of bridges per SB/VM:
# unspecified or 0   --> will be set to 1
# > 1 <= 5           --> will be set to the specified number
# > 5                --> will be set to 5
default_bridges = 1

# Default memory size in MiB for SB/VM.
# If unspecified then it will be set 2048 MiB.
#default_memory = 2048

# Disable block device from being used for a container's rootfs.
# In case of a storage driver like devicemapper where a container's
# root file system is backed by a block device, the block device is passed
# directly to the hypervisor for performance reasons.
# This flag prevents the block device from being passed to the hypervisor,
# 9pfs is used instead to pass the rootfs.
disable_block_device_use = false

# Block storage driver to be used for the hypervisor in case the container
# rootfs is backed by a block device. This is either virtio-scsi or
# virtio-blk.
block_device_driver = "virtio-scsi"

# Enable iothreads (data-plane) to be used. This causes IO to be
# handled in a separate IO thread. This is currently only implemented
# for SCSI.
#
enable_iothreads = false

# Enable pre allocation of VM RAM, default false
# Enabling this will result in lower container density
# as all of the memory will be allocated and locked
# This is useful when you want to reserve all the memory
# upfront or in the cases where you want memory latencies
# to be very predictable
# Default false
#enable_mem_prealloc = true

# Enable huge pages for VM RAM, default false
# Enabling this will result in the VM memory
# being allocated using huge pages.
# This is useful when you want to use vhost-user network
# stacks within the container. This will automatically
# result in memory pre allocation
#enable_hugepages = true

# Enable swap of vm memory. Default false.
# The behaviour is undefined if mem_prealloc is also set to true
#enable_swap = true

# This option changes the default hypervisor and kernel parameters
# to enable debug output where available. This extra output is added
# to the proxy logs, but only when proxy debug is also enabled.
#
# Default false
enable_debug = true

# Disable the customizations done in the runtime when it detects
# that it is running on top a VMM. This will result in the runtime
# behaving as it would when running on bare metal.
#
#disable_nesting_checks = true

# This is the msize used for 9p shares. It is the number of bytes
# used for 9p packet payload.
#msize_9p = 8192

# If true and vsocks are supported, use vsocks to communicate directly
# with the agent and no proxy is started, otherwise use unix
# sockets and start a proxy to communicate with the agent.
# Default false
#use_vsock = true

# VFIO devices are hotplugged on a bridge by default.
# Enable hotplugging on root bus. This may be required for devices with
# a large PCI bar, as this is a current limitation with hotplugging on
# a bridge. This value is valid for "pc" machine type.
# Default false
#hotplug_vfio_on_root_bus = true

[factory]
# VM templating support. Once enabled, new VMs are created from template
# using vm cloning. They will share the same initial kernel, initramfs and
# agent memory by mapping it readonly. It helps speeding up new container
# creation and saves a lot of memory if there are many kata containers running
# on the same host.
#
# When disabled, new VMs are created from scratch.
#
# Default false
#enable_template = true

[proxy.kata]
path = "/usr/libexec/kata-containers/kata-proxy"

# If enabled, proxy messages will be sent to the system log
# (default: disabled)
enable_debug = true

[shim.kata]
path = "/usr/libexec/kata-containers/kata-shim"

# If enabled, shim messages will be sent to the system log
# (default: disabled)
enable_debug = true

[agent.kata]
# There is no field for this section. The goal is only to be able to
# specify which type of agent the user wants to use.

[runtime]
# If enabled, the runtime will log additional debug messages to the
# system log
# (default: disabled)
enable_debug = true
#
# Internetworking model
# Determines how the VM should be connected to the
# the container network interface
# Options:
#
#   - bridged
#     Uses a linux bridge to interconnect the container interface to
#     the VM. Works for most cases except macvlan and ipvlan.
#
#   - macvtap
#     Used when the Container network interface can be bridged using
#     macvtap.
internetworking_model="macvtap"

# If enabled, the runtime will create opentracing.io traces and spans.
# (See https://www.jaegertracing.io/docs/getting-started).
# (default: disabled)
#enable_tracing = true

Image details

---
osbuilder:
  url: "https://github.com/kata-containers/osbuilder"
  version: "unknown"
rootfs-creation-time: "2018-08-13T22:51:39.765008919+0000Z"
description: "osbuilder rootfs"
file-format-version: "0.0.2"
architecture: "x86_64"
base-distro:
  name: "Clear"
  version: "24400"
  packages:
    default:
      - "iptables-bin"
      - "libudev0-shim"
      - "systemd"
    extra:

agent:
  url: "https://github.com/kata-containers/agent"
  name: "kata-agent"
  version: "1.2.0-fcfa054a757e7c17afba47b0b4d7e91cbb8688ed"
  agent-is-init-daemon: "no"

Initrd details

No initrd

Logfiles

Runtime logs

Recent runtime problems found in system journal:

time="2018-08-29T15:59:56.944332582Z" level=error msg="Container e7c7303fa0bea584a309c46a18e47205f36084ff7b4d58fa2139d8efdaf75d39 not ready, running or paused, cannot send a signal" arch=amd64 command=kill container=e7c7303fa0bea584a309c46a18e47205f36084ff7b4d58fa2139d8efdaf75d39 name=kata-runtime pid=5538 sandbox=e7c7303fa0bea584a309c46a18e47205f36084ff7b4d58fa2139d8efdaf75d39 source=runtime
time="2018-08-29T15:59:56.949383947Z" level=error msg="Container d94f0595f52a37307544b9e6f1b9369f8e2d73b8d9e2b22b7dacd859ec8c010f not ready, running or paused, cannot send a signal" arch=amd64 command=kill container=d94f0595f52a37307544b9e6f1b9369f8e2d73b8d9e2b22b7dacd859ec8c010f name=kata-runtime pid=5545 sandbox=d94f0595f52a37307544b9e6f1b9369f8e2d73b8d9e2b22b7dacd859ec8c010f source=runtime
time="2018-08-29T16:06:44.02752336Z" level=debug msg="Could not retrieve anything from storage" arch=amd64 command=create container=6543225c3c95c1f10d852c8f7426ce55d78ca6673aa7c0336e958820b86f1c82 name=kata-runtime pid=9804 source=virtcontainers subsystem=kata_agent
time="2018-08-29T16:06:44.02759486Z" level=warning msg="fetch sandbox device failed" arch=amd64 command=create container=6543225c3c95c1f10d852c8f7426ce55d78ca6673aa7c0336e958820b86f1c82 error="open /run/vc/sbs/6543225c3c95c1f10d852c8f7426ce55d78ca6673aa7c0336e958820b86f1c82/devices.json: no such file or directory" name=kata-runtime pid=9804 sandbox=6543225c3c95c1f10d852c8f7426ce55d78ca6673aa7c0336e958820b86f1c82 sandboxid=6543225c3c95c1f10d852c8f7426ce55d78ca6673aa7c0336e958820b86f1c82 source=virtcontainers subsystem=sandbox
time="2018-08-29T16:06:44.030968235Z" level=debug arch=amd64 command=create container=6543225c3c95c1f10d852c8f7426ce55d78ca6673aa7c0336e958820b86f1c82 default-kernel-parameters="tsc=reliable no_timer_check rcupdate.rcu_expedited=1 i8042.direct=1 i8042.dumbkbd=1 i8042.nopnp=1 i8042.noaux=1 noreplace-smp reboot=k console=hvc0 console=hvc1 iommu=off cryptomgr.notests net.ifnames=0 pci=lastbus=0 root=/dev/pmem0p1 rootflags=dax,data=ordered,errors=remount-ro rw rootfstype=ext4 debug systemd.show_status=true systemd.log_level=debug" name=kata-runtime pid=9804 source=virtcontainers subsystem=qemu
time="2018-08-29T16:06:45.920240462Z" level=warning msg="unsupported address" address="fe80::bc16:6cff:fe39:dd3f/64" arch=amd64 command=create container=6543225c3c95c1f10d852c8f7426ce55d78ca6673aa7c0336e958820b86f1c82 name=kata-runtime pid=9804 source=virtcontainers subsystem=network unsupported-address-type=ipv6
time="2018-08-29T16:06:45.920354161Z" level=warning msg="unsupported route" arch=amd64 command=create container=6543225c3c95c1f10d852c8f7426ce55d78ca6673aa7c0336e958820b86f1c82 destination="fe80::/64" name=kata-runtime pid=9804 source=virtcontainers subsystem=network unsupported-route-type=ipv6
time="2018-08-29T16:10:27.081830145Z" level=debug msg="Could not retrieve anything from storage" arch=amd64 command=create container=963ef7597ad2400ad6b37490a7bc28e6caf037a162e072618f3f69e76cacb583 name=kata-runtime pid=14571 source=virtcontainers subsystem=kata_agent
time="2018-08-29T16:10:27.081902644Z" level=warning msg="fetch sandbox device failed" arch=amd64 command=create container=963ef7597ad2400ad6b37490a7bc28e6caf037a162e072618f3f69e76cacb583 error="open /run/vc/sbs/963ef7597ad2400ad6b37490a7bc28e6caf037a162e072618f3f69e76cacb583/devices.json: no such file or directory" name=kata-runtime pid=14571 sandbox=963ef7597ad2400ad6b37490a7bc28e6caf037a162e072618f3f69e76cacb583 sandboxid=963ef7597ad2400ad6b37490a7bc28e6caf037a162e072618f3f69e76cacb583 source=virtcontainers subsystem=sandbox
time="2018-08-29T16:10:27.085017621Z" level=debug arch=amd64 command=create container=963ef7597ad2400ad6b37490a7bc28e6caf037a162e072618f3f69e76cacb583 default-kernel-parameters="tsc=reliable no_timer_check rcupdate.rcu_expedited=1 i8042.direct=1 i8042.dumbkbd=1 i8042.nopnp=1 i8042.noaux=1 noreplace-smp reboot=k console=hvc0 console=hvc1 iommu=off cryptomgr.notests net.ifnames=0 pci=lastbus=0 root=/dev/pmem0p1 rootflags=dax,data=ordered,errors=remount-ro rw rootfstype=ext4 debug systemd.show_status=true systemd.log_level=debug" name=kata-runtime pid=14571 source=virtcontainers subsystem=qemu
time="2018-08-29T16:10:29.104534061Z" level=warning msg="unsupported address" address="fe80::1055:b3ff:feeb:283d/64" arch=amd64 command=create container=963ef7597ad2400ad6b37490a7bc28e6caf037a162e072618f3f69e76cacb583 name=kata-runtime pid=14571 source=virtcontainers subsystem=network unsupported-address-type=ipv6
time="2018-08-29T16:10:29.105139556Z" level=warning msg="unsupported route" arch=amd64 command=create container=963ef7597ad2400ad6b37490a7bc28e6caf037a162e072618f3f69e76cacb583 destination="fe80::/64" name=kata-runtime pid=14571 source=virtcontainers subsystem=network unsupported-route-type=ipv6
time="2018-08-29T16:10:57.617613359Z" level=debug msg="Could not retrieve anything from storage" arch=amd64 command=create container=a610cf52cf24cc5fcce1aafdaa90a5453a41ef46be5b8bcfaaeea122ade43338 name=kata-runtime pid=15677 source=virtcontainers subsystem=kata_agent
time="2018-08-29T16:10:57.617684559Z" level=warning msg="fetch sandbox device failed" arch=amd64 command=create container=a610cf52cf24cc5fcce1aafdaa90a5453a41ef46be5b8bcfaaeea122ade43338 error="open /run/vc/sbs/a610cf52cf24cc5fcce1aafdaa90a5453a41ef46be5b8bcfaaeea122ade43338/devices.json: no such file or directory" name=kata-runtime pid=15677 sandbox=a610cf52cf24cc5fcce1aafdaa90a5453a41ef46be5b8bcfaaeea122ade43338 sandboxid=a610cf52cf24cc5fcce1aafdaa90a5453a41ef46be5b8bcfaaeea122ade43338 source=virtcontainers subsystem=sandbox
time="2018-08-29T16:10:57.621707829Z" level=debug arch=amd64 command=create container=a610cf52cf24cc5fcce1aafdaa90a5453a41ef46be5b8bcfaaeea122ade43338 default-kernel-parameters="tsc=reliable no_timer_check rcupdate.rcu_expedited=1 i8042.direct=1 i8042.dumbkbd=1 i8042.nopnp=1 i8042.noaux=1 noreplace-smp reboot=k console=hvc0 console=hvc1 iommu=off cryptomgr.notests net.ifnames=0 pci=lastbus=0 root=/dev/pmem0p1 rootflags=dax,data=ordered,errors=remount-ro rw rootfstype=ext4 debug systemd.show_status=true systemd.log_level=debug" name=kata-runtime pid=15677 source=virtcontainers subsystem=qemu
time="2018-08-29T16:10:57.832790973Z" level=debug msg="Could not retrieve anything from storage" arch=amd64 command=create container=7d661ffdbfbd9b79bff552382def3b1b0cb94fdb0ac6b6853a17fba5ab9638e5 name=kata-runtime pid=15735 source=virtcontainers subsystem=kata_agent
time="2018-08-29T16:10:57.832876172Z" level=warning msg="fetch sandbox device failed" arch=amd64 command=create container=7d661ffdbfbd9b79bff552382def3b1b0cb94fdb0ac6b6853a17fba5ab9638e5 error="open /run/vc/sbs/7d661ffdbfbd9b79bff552382def3b1b0cb94fdb0ac6b6853a17fba5ab9638e5/devices.json: no such file or directory" name=kata-runtime pid=15735 sandbox=7d661ffdbfbd9b79bff552382def3b1b0cb94fdb0ac6b6853a17fba5ab9638e5 sandboxid=7d661ffdbfbd9b79bff552382def3b1b0cb94fdb0ac6b6853a17fba5ab9638e5 source=virtcontainers subsystem=sandbox
time="2018-08-29T16:10:57.837967735Z" level=debug arch=amd64 command=create container=7d661ffdbfbd9b79bff552382def3b1b0cb94fdb0ac6b6853a17fba5ab9638e5 default-kernel-parameters="tsc=reliable no_timer_check rcupdate.rcu_expedited=1 i8042.direct=1 i8042.dumbkbd=1 i8042.nopnp=1 i8042.noaux=1 noreplace-smp reboot=k console=hvc0 console=hvc1 iommu=off cryptomgr.notests net.ifnames=0 pci=lastbus=0 root=/dev/pmem0p1 rootflags=dax,data=ordered,errors=remount-ro rw rootfstype=ext4 debug systemd.show_status=true systemd.log_level=debug" name=kata-runtime pid=15735 source=virtcontainers subsystem=qemu
time="2018-08-29T16:10:59.862986007Z" level=warning msg="unsupported address" address="fe80::416:83ff:feeb:5483/64" arch=amd64 command=create container=a610cf52cf24cc5fcce1aafdaa90a5453a41ef46be5b8bcfaaeea122ade43338 name=kata-runtime pid=15677 source=virtcontainers subsystem=network unsupported-address-type=ipv6
time="2018-08-29T16:10:59.863110507Z" level=warning msg="unsupported route" arch=amd64 command=create container=a610cf52cf24cc5fcce1aafdaa90a5453a41ef46be5b8bcfaaeea122ade43338 destination="fe80::/64" name=kata-runtime pid=15677 source=virtcontainers subsystem=network unsupported-route-type=ipv6
time="2018-08-29T16:11:00.091993119Z" level=warning msg="unsupported address" address="fe80::f4a3:d1ff:fe92:efd7/64" arch=amd64 command=create container=7d661ffdbfbd9b79bff552382def3b1b0cb94fdb0ac6b6853a17fba5ab9638e5 name=kata-runtime pid=15735 source=virtcontainers subsystem=network unsupported-address-type=ipv6
time="2018-08-29T16:11:00.092636814Z" level=warning msg="unsupported route" arch=amd64 command=create container=7d661ffdbfbd9b79bff552382def3b1b0cb94fdb0ac6b6853a17fba5ab9638e5 destination="fe80::/64" name=kata-runtime pid=15735 source=virtcontainers subsystem=network unsupported-route-type=ipv6
time="2018-08-29T16:11:08.710542668Z" level=debug msg="Could not retrieve anything from storage" arch=amd64 command=create container=a58b3bff1ff2be8a66cfc757d8cc6420dbb4db3bf8d8c1d4838086ff8046672d name=kata-runtime pid=16346 source=virtcontainers subsystem=kata_agent
time="2018-08-29T16:11:08.710612567Z" level=warning msg="fetch sandbox device failed" arch=amd64 command=create container=a58b3bff1ff2be8a66cfc757d8cc6420dbb4db3bf8d8c1d4838086ff8046672d error="open /run/vc/sbs/a58b3bff1ff2be8a66cfc757d8cc6420dbb4db3bf8d8c1d4838086ff8046672d/devices.json: no such file or directory" name=kata-runtime pid=16346 sandbox=a58b3bff1ff2be8a66cfc757d8cc6420dbb4db3bf8d8c1d4838086ff8046672d sandboxid=a58b3bff1ff2be8a66cfc757d8cc6420dbb4db3bf8d8c1d4838086ff8046672d source=virtcontainers subsystem=sandbox
time="2018-08-29T16:11:08.714236041Z" level=debug arch=amd64 command=create container=a58b3bff1ff2be8a66cfc757d8cc6420dbb4db3bf8d8c1d4838086ff8046672d default-kernel-parameters="tsc=reliable no_timer_check rcupdate.rcu_expedited=1 i8042.direct=1 i8042.dumbkbd=1 i8042.nopnp=1 i8042.noaux=1 noreplace-smp reboot=k console=hvc0 console=hvc1 iommu=off cryptomgr.notests net.ifnames=0 pci=lastbus=0 root=/dev/pmem0p1 rootflags=dax,data=ordered,errors=remount-ro rw rootfstype=ext4 debug systemd.show_status=true systemd.log_level=debug" name=kata-runtime pid=16346 source=virtcontainers subsystem=qemu
time="2018-08-29T16:11:10.857514832Z" level=warning msg="unsupported address" address="fe80::85a:d3ff:fec6:118d/64" arch=amd64 command=create container=a58b3bff1ff2be8a66cfc757d8cc6420dbb4db3bf8d8c1d4838086ff8046672d name=kata-runtime pid=16346 source=virtcontainers subsystem=network unsupported-address-type=ipv6
time="2018-08-29T16:11:10.857640731Z" level=warning msg="unsupported route" arch=amd64 command=create container=a58b3bff1ff2be8a66cfc757d8cc6420dbb4db3bf8d8c1d4838086ff8046672d destination="fe80::/64" name=kata-runtime pid=16346 source=virtcontainers subsystem=network unsupported-route-type=ipv6
time="2018-08-29T16:13:10.070431549Z" level=debug msg="Could not retrieve anything from storage" arch=amd64 command=create container=83d7555f432f2e1bb969f12b716eeea49ac00ed5439fed5c454dc899b282fbda name=kata-runtime pid=19275 source=virtcontainers subsystem=kata_agent
time="2018-08-29T16:13:10.070472549Z" level=warning msg="fetch sandbox device failed" arch=amd64 command=create container=83d7555f432f2e1bb969f12b716eeea49ac00ed5439fed5c454dc899b282fbda error="open /run/vc/sbs/83d7555f432f2e1bb969f12b716eeea49ac00ed5439fed5c454dc899b282fbda/devices.json: no such file or directory" name=kata-runtime pid=19275 sandbox=83d7555f432f2e1bb969f12b716eeea49ac00ed5439fed5c454dc899b282fbda sandboxid=83d7555f432f2e1bb969f12b716eeea49ac00ed5439fed5c454dc899b282fbda source=virtcontainers subsystem=sandbox
time="2018-08-29T16:13:10.073810224Z" level=debug arch=amd64 command=create container=83d7555f432f2e1bb969f12b716eeea49ac00ed5439fed5c454dc899b282fbda default-kernel-parameters="tsc=reliable no_timer_check rcupdate.rcu_expedited=1 i8042.direct=1 i8042.dumbkbd=1 i8042.nopnp=1 i8042.noaux=1 noreplace-smp reboot=k console=hvc0 console=hvc1 iommu=off cryptomgr.notests net.ifnames=0 pci=lastbus=0 root=/dev/pmem0p1 rootflags=dax,data=ordered,errors=remount-ro rw rootfstype=ext4 debug systemd.show_status=true systemd.log_level=debug" name=kata-runtime pid=19275 source=virtcontainers subsystem=qemu
time="2018-08-29T16:13:11.880152423Z" level=warning msg="unsupported address" address="fe80::3c21:85ff:fee1:35de/64" arch=amd64 command=create container=83d7555f432f2e1bb969f12b716eeea49ac00ed5439fed5c454dc899b282fbda name=kata-runtime pid=19275 source=virtcontainers subsystem=network unsupported-address-type=ipv6
time="2018-08-29T16:13:11.880281322Z" level=warning msg="unsupported route" arch=amd64 command=create container=83d7555f432f2e1bb969f12b716eeea49ac00ed5439fed5c454dc899b282fbda destination="fe80::/64" name=kata-runtime pid=19275 source=virtcontainers subsystem=network unsupported-route-type=ipv6
time="2018-08-29T16:13:21.476993407Z" level=debug msg="Could not retrieve anything from storage" arch=amd64 command=create container=3015463b7faee365658b9c187df001d374027f1d7d4774fdcf51d1b65ee8ba49 name=kata-runtime pid=19720 source=virtcontainers subsystem=kata_agent
time="2018-08-29T16:13:21.477061706Z" level=warning msg="fetch sandbox device failed" arch=amd64 command=create container=3015463b7faee365658b9c187df001d374027f1d7d4774fdcf51d1b65ee8ba49 error="open /run/vc/sbs/3015463b7faee365658b9c187df001d374027f1d7d4774fdcf51d1b65ee8ba49/devices.json: no such file or directory" name=kata-runtime pid=19720 sandbox=3015463b7faee365658b9c187df001d374027f1d7d4774fdcf51d1b65ee8ba49 sandboxid=3015463b7faee365658b9c187df001d374027f1d7d4774fdcf51d1b65ee8ba49 source=virtcontainers subsystem=sandbox
time="2018-08-29T16:13:21.480074084Z" level=debug arch=amd64 command=create container=3015463b7faee365658b9c187df001d374027f1d7d4774fdcf51d1b65ee8ba49 default-kernel-parameters="tsc=reliable no_timer_check rcupdate.rcu_expedited=1 i8042.direct=1 i8042.dumbkbd=1 i8042.nopnp=1 i8042.noaux=1 noreplace-smp reboot=k console=hvc0 console=hvc1 iommu=off cryptomgr.notests net.ifnames=0 pci=lastbus=0 root=/dev/pmem0p1 rootflags=dax,data=ordered,errors=remount-ro rw rootfstype=ext4 debug systemd.show_status=true systemd.log_level=debug" name=kata-runtime pid=19720 source=virtcontainers subsystem=qemu
time="2018-08-29T16:13:23.32229621Z" level=warning msg="unsupported address" address="fe80::64bc:ff:fe57:29ac/64" arch=amd64 command=create container=3015463b7faee365658b9c187df001d374027f1d7d4774fdcf51d1b65ee8ba49 name=kata-runtime pid=19720 source=virtcontainers subsystem=network unsupported-address-type=ipv6
time="2018-08-29T16:13:23.322433409Z" level=warning msg="unsupported route" arch=amd64 command=create container=3015463b7faee365658b9c187df001d374027f1d7d4774fdcf51d1b65ee8ba49 destination="fe80::/64" name=kata-runtime pid=19720 source=virtcontainers subsystem=network unsupported-route-type=ipv6
time="2018-08-29T16:15:20.71799553Z" level=debug msg="Could not retrieve anything from storage" arch=amd64 command=create container=7552dc0f155db6891e46ba661de689b6123d357ec30624ba435605ef47716f15 name=kata-runtime pid=22493 source=virtcontainers subsystem=kata_agent
time="2018-08-29T16:15:20.71807843Z" level=warning msg="fetch sandbox device failed" arch=amd64 command=create container=7552dc0f155db6891e46ba661de689b6123d357ec30624ba435605ef47716f15 error="open /run/vc/sbs/7552dc0f155db6891e46ba661de689b6123d357ec30624ba435605ef47716f15/devices.json: no such file or directory" name=kata-runtime pid=22493 sandbox=7552dc0f155db6891e46ba661de689b6123d357ec30624ba435605ef47716f15 sandboxid=7552dc0f155db6891e46ba661de689b6123d357ec30624ba435605ef47716f15 source=virtcontainers subsystem=sandbox
time="2018-08-29T16:15:20.721743402Z" level=debug arch=amd64 command=create container=7552dc0f155db6891e46ba661de689b6123d357ec30624ba435605ef47716f15 default-kernel-parameters="tsc=reliable no_timer_check rcupdate.rcu_expedited=1 i8042.direct=1 i8042.dumbkbd=1 i8042.nopnp=1 i8042.noaux=1 noreplace-smp reboot=k console=hvc0 console=hvc1 iommu=off cryptomgr.notests net.ifnames=0 pci=lastbus=0 root=/dev/pmem0p1 rootflags=dax,data=ordered,errors=remount-ro rw rootfstype=ext4 debug systemd.show_status=true systemd.log_level=debug" name=kata-runtime pid=22493 source=virtcontainers subsystem=qemu
time="2018-08-29T16:15:22.569736825Z" level=warning msg="unsupported address" address="fe80::ac52:27ff:fe9d:b454/64" arch=amd64 command=create container=7552dc0f155db6891e46ba661de689b6123d357ec30624ba435605ef47716f15 name=kata-runtime pid=22493 source=virtcontainers subsystem=network unsupported-address-type=ipv6
time="2018-08-29T16:15:22.569851924Z" level=warning msg="unsupported route" arch=amd64 command=create container=7552dc0f155db6891e46ba661de689b6123d357ec30624ba435605ef47716f15 destination="fe80::/64" name=kata-runtime pid=22493 source=virtcontainers subsystem=network unsupported-route-type=ipv6
time="2018-08-29T16:17:30.363938611Z" level=debug msg="Could not retrieve anything from storage" arch=amd64 command=create container=6055cfd6b9ffdb418b53838d822955114fb3b6ecc271ac56d6171a286c077d99 name=kata-runtime pid=25222 source=virtcontainers subsystem=kata_agent
time="2018-08-29T16:17:30.36401671Z" level=warning msg="fetch sandbox device failed" arch=amd64 command=create container=6055cfd6b9ffdb418b53838d822955114fb3b6ecc271ac56d6171a286c077d99 error="open /run/vc/sbs/6055cfd6b9ffdb418b53838d822955114fb3b6ecc271ac56d6171a286c077d99/devices.json: no such file or directory" name=kata-runtime pid=25222 sandbox=6055cfd6b9ffdb418b53838d822955114fb3b6ecc271ac56d6171a286c077d99 sandboxid=6055cfd6b9ffdb418b53838d822955114fb3b6ecc271ac56d6171a286c077d99 source=virtcontainers subsystem=sandbox
time="2018-08-29T16:17:30.367551384Z" level=debug arch=amd64 command=create container=6055cfd6b9ffdb418b53838d822955114fb3b6ecc271ac56d6171a286c077d99 default-kernel-parameters="tsc=reliable no_timer_check rcupdate.rcu_expedited=1 i8042.direct=1 i8042.dumbkbd=1 i8042.nopnp=1 i8042.noaux=1 noreplace-smp reboot=k console=hvc0 console=hvc1 iommu=off cryptomgr.notests net.ifnames=0 pci=lastbus=0 root=/dev/pmem0p1 rootflags=dax,data=ordered,errors=remount-ro rw rootfstype=ext4 debug systemd.show_status=true systemd.log_level=debug" name=kata-runtime pid=25222 source=virtcontainers subsystem=qemu
time="2018-08-29T16:17:32.372801878Z" level=warning msg="unsupported address" address="fe80::a410:b6ff:feaf:cf5/64" arch=amd64 command=create container=6055cfd6b9ffdb418b53838d822955114fb3b6ecc271ac56d6171a286c077d99 name=kata-runtime pid=25222 source=virtcontainers subsystem=network unsupported-address-type=ipv6
time="2018-08-29T16:17:32.372930377Z" level=warning msg="unsupported route" arch=amd64 command=create container=6055cfd6b9ffdb418b53838d822955114fb3b6ecc271ac56d6171a286c077d99 destination="fe80::/64" name=kata-runtime pid=25222 source=virtcontainers subsystem=network unsupported-route-type=ipv6
time="2018-08-29T16:43:44.05166845Z" level=debug msg="Could not retrieve anything from storage" arch=amd64 command=create container=75ad743b654596a6d32e0c005093a1574411573951119ebb256a316093d493df name=kata-runtime pid=29906 source=virtcontainers subsystem=kata_agent
time="2018-08-29T16:43:44.051736449Z" level=warning msg="fetch sandbox device failed" arch=amd64 command=create container=75ad743b654596a6d32e0c005093a1574411573951119ebb256a316093d493df error="open /run/vc/sbs/75ad743b654596a6d32e0c005093a1574411573951119ebb256a316093d493df/devices.json: no such file or directory" name=kata-runtime pid=29906 sandbox=75ad743b654596a6d32e0c005093a1574411573951119ebb256a316093d493df sandboxid=75ad743b654596a6d32e0c005093a1574411573951119ebb256a316093d493df source=virtcontainers subsystem=sandbox
time="2018-08-29T16:43:44.052279545Z" level=error msg="Host networking requested, not supported by runtime" arch=amd64 command=create container=75ad743b654596a6d32e0c005093a1574411573951119ebb256a316093d493df name=kata-runtime pid=29906 source=runtime

Proxy logs

Recent proxy problems found in system journal:

time="2018-08-29T16:17:32.668702064Z" level=info msg="time=\"2018-08-29T16:17:32.640291795Z\" level=debug msg=\"request end\" duration=186.270914ms name=kata-agent pid=99 request=/grpc.AgentService/CreateContainer resp=\"&Empty{}\" sandbox=6055cfd6b9ffdb418b53838d822955114fb3b6ecc271ac56d6171a286c077d99 source=agent\n" name=kata-proxy pid=25263 sandbox=6055cfd6b9ffdb418b53838d822955114fb3b6ecc271ac56d6171a286c077d99 source=agent
time="2018-08-29T16:17:32.669703556Z" level=info msg="time=\"2018-08-29T16:17:32.641311412Z\" level=info msg=\"ignoring unexpected signal\" name=kata-agent pid=99 sandbox=6055cfd6b9ffdb418b53838d822955114fb3b6ecc271ac56d6171a286c077d99 signal=\"child exited\" source=agent\n" name=kata-proxy pid=25263 sandbox=6055cfd6b9ffdb418b53838d822955114fb3b6ecc271ac56d6171a286c077d99 source=agent
time="2018-08-29T16:17:32.705500088Z" level=info msg="time=\"2018-08-29T16:17:32.677297316Z\" level=debug msg=\"request end\" duration=\"8.206µs\" name=kata-agent pid=99 request=/grpc.AgentService/CloseStdin resp=\"&Empty{}\" sandbox=6055cfd6b9ffdb418b53838d822955114fb3b6ecc271ac56d6171a286c077d99 source=agent\n" name=kata-proxy pid=25263 sandbox=6055cfd6b9ffdb418b53838d822955114fb3b6ecc271ac56d6171a286c077d99 source=agent
time="2018-08-29T16:17:32.719480384Z" level=info msg="time=\"2018-08-29T16:17:32.691066011Z\" level=debug msg=\"request end\" duration=17.517344ms name=kata-agent pid=99 request=/grpc.AgentService/StartContainer resp=\"&Empty{}\" sandbox=6055cfd6b9ffdb418b53838d822955114fb3b6ecc271ac56d6171a286c077d99 source=agent\n" name=kata-proxy pid=25263 sandbox=6055cfd6b9ffdb418b53838d822955114fb3b6ecc271ac56d6171a286c077d99 source=agent
time="2018-08-29T16:17:38.426901469Z" level=info msg="time=\"2018-08-29T16:17:38.398616154Z\" level=debug msg=\"request end\" duration=71.312951ms name=kata-agent pid=99 request=/grpc.AgentService/CreateContainer resp=\"&Empty{}\" sandbox=6055cfd6b9ffdb418b53838d822955114fb3b6ecc271ac56d6171a286c077d99 source=agent\n" name=kata-proxy pid=25263 sandbox=6055cfd6b9ffdb418b53838d822955114fb3b6ecc271ac56d6171a286c077d99 source=agent
time="2018-08-29T16:17:38.428472557Z" level=info msg="time=\"2018-08-29T16:17:38.400174359Z\" level=info msg=\"ignoring unexpected signal\" name=kata-agent pid=99 sandbox=6055cfd6b9ffdb418b53838d822955114fb3b6ecc271ac56d6171a286c077d99 signal=\"child exited\" source=agent\n" name=kata-proxy pid=25263 sandbox=6055cfd6b9ffdb418b53838d822955114fb3b6ecc271ac56d6171a286c077d99 source=agent
time="2018-08-29T16:17:38.448204109Z" level=info msg="time=\"2018-08-29T16:17:38.419462311Z\" level=debug msg=\"request end\" duration=\"8.538µs\" name=kata-agent pid=99 request=/grpc.AgentService/CloseStdin resp=\"&Empty{}\" sandbox=6055cfd6b9ffdb418b53838d822955114fb3b6ecc271ac56d6171a286c077d99 source=agent\n" name=kata-proxy pid=25263 sandbox=6055cfd6b9ffdb418b53838d822955114fb3b6ecc271ac56d6171a286c077d99 source=agent
time="2018-08-29T16:17:38.487574515Z" level=info msg="time=\"2018-08-29T16:17:38.45920241Z\" level=debug msg=\"request end\" duration=5.966158ms name=kata-agent pid=99 request=/grpc.AgentService/StartContainer resp=\"&Empty{}\" sandbox=6055cfd6b9ffdb418b53838d822955114fb3b6ecc271ac56d6171a286c077d99 source=agent\n" name=kata-proxy pid=25263 sandbox=6055cfd6b9ffdb418b53838d822955114fb3b6ecc271ac56d6171a286c077d99 source=agent
time="2018-08-29T16:17:39.650045214Z" level=debug msg="Copy stream error" error="read unix /run/vc/sbs/6055cfd6b9ffdb418b53838d822955114fb3b6ecc271ac56d6171a286c077d99/proxy.sock->@: use of closed network connection" name=kata-proxy pid=25263 sandbox=6055cfd6b9ffdb418b53838d822955114fb3b6ecc271ac56d6171a286c077d99 source=proxy
time="2018-08-29T16:17:39.650086813Z" level=debug msg="Copy stream error" error="read unix /run/vc/sbs/6055cfd6b9ffdb418b53838d822955114fb3b6ecc271ac56d6171a286c077d99/proxy.sock->@: use of closed network connection" name=kata-proxy pid=25263 sandbox=6055cfd6b9ffdb418b53838d822955114fb3b6ecc271ac56d6171a286c077d99 source=proxy
time="2018-08-29T16:17:39.651036706Z" level=fatal msg="channel error" error="session shutdown" name=kata-proxy pid=25263 sandbox=6055cfd6b9ffdb418b53838d822955114fb3b6ecc271ac56d6171a286c077d99 source=proxy
time="2018-08-29T16:19:57.641291342Z" level=info msg="time=\"2018-08-29T16:19:57.612505549Z\" level=debug msg=\"request end\" duration=9m26.469043963s name=kata-agent pid=104 request=/grpc.AgentService/ReadStderr resp=\"data:\\\"E0829 16:19:57.612296       1 reflector.go:304] k8s.io/dns/pkg/dns/dns.go:150: Failed to watch *v1.Service: the server has asked for the client to provide credentials (get services)\\\\n\\\" \" sandbox=963ef7597ad2400ad6b37490a7bc28e6caf037a162e072618f3f69e76cacb583 source=agent\n" name=kata-proxy pid=14616 sandbox=963ef7597ad2400ad6b37490a7bc28e6caf037a162e072618f3f69e76cacb583 source=agent
time="2018-08-29T16:20:22.911062286Z" level=info msg="time=\"2018-08-29T16:20:22.883983747Z\" level=debug msg=\"request end\" duration=2.350696ms name=kata-agent pid=104 request=/grpc.AgentService/SignalProcess resp=\"&Empty{}\" sandbox=963ef7597ad2400ad6b37490a7bc28e6caf037a162e072618f3f69e76cacb583 source=agent\n" name=kata-proxy pid=14616 sandbox=963ef7597ad2400ad6b37490a7bc28e6caf037a162e072618f3f69e76cacb583 source=agent
time="2018-08-29T16:20:22.95056119Z" level=info msg="time=\"2018-08-29T16:20:22.921692738Z\" level=debug msg=\"request end\" duration=9m52.467287548s error=EOF name=kata-agent pid=104 request=/grpc.AgentService/ReadStdout resp= sandbox=963ef7597ad2400ad6b37490a7bc28e6caf037a162e072618f3f69e76cacb583 source=agent\n" name=kata-proxy pid=14616 sandbox=963ef7597ad2400ad6b37490a7bc28e6caf037a162e072618f3f69e76cacb583 source=agent
time="2018-08-29T16:20:22.950685289Z" level=info msg="time=\"2018-08-29T16:20:22.92302418Z\" level=debug msg=\"request end\" duration=9m51.601541708s error=EOF name=kata-agent pid=104 request=/grpc.AgentService/ReadStderr resp= sandbox=963ef7597ad2400ad6b37490a7bc28e6caf037a162e072618f3f69e76cacb583 source=agent\n" name=kata-proxy pid=14616 sandbox=963ef7597ad2400ad6b37490a7bc28e6caf037a162e072618f3f69e76cacb583 source=agent
time="2018-08-29T16:20:22.951347484Z" level=info msg="time=\"2018-08-29T16:20:22.925528819Z\" level=info msg=\"ignoring unexpected signal\" name=kata-agent pid=104 sandbox=963ef7597ad2400ad6b37490a7bc28e6caf037a162e072618f3f69e76cacb583 signal=\"child exited\" source=agent\n" name=kata-proxy pid=14616 sandbox=963ef7597ad2400ad6b37490a7bc28e6caf037a162e072618f3f69e76cacb583 source=agent
time="2018-08-29T16:20:23.062576648Z" level=info msg="time=\"2018-08-29T16:20:23.032646632Z\" level=debug msg=\"request end\" duration=6.569339ms name=kata-agent pid=104 request=/grpc.AgentService/SignalProcess resp=\"&Empty{}\" sandbox=963ef7597ad2400ad6b37490a7bc28e6caf037a162e072618f3f69e76cacb583 source=agent\n" name=kata-proxy pid=14616 sandbox=963ef7597ad2400ad6b37490a7bc28e6caf037a162e072618f3f69e76cacb583 source=agent
time="2018-08-29T16:20:23.064762732Z" level=debug msg="Copy stream error" error="write unix /run/vc/sbs/963ef7597ad2400ad6b37490a7bc28e6caf037a162e072618f3f69e76cacb583/proxy.sock->@: use of closed network connection" name=kata-proxy pid=14616 sandbox=963ef7597ad2400ad6b37490a7bc28e6caf037a162e072618f3f69e76cacb583 source=proxy
time="2018-08-29T16:20:23.074582758Z" level=info msg="time=\"2018-08-29T16:20:23.045038613Z\" level=debug msg=\"request end\" duration=1.998761ms name=kata-agent pid=104 request=/grpc.AgentService/RemoveContainer resp=\"&Empty{}\" sandbox=963ef7597ad2400ad6b37490a7bc28e6caf037a162e072618f3f69e76cacb583 source=agent\n" name=kata-proxy pid=14616 sandbox=963ef7597ad2400ad6b37490a7bc28e6caf037a162e072618f3f69e76cacb583 source=agent
time="2018-08-29T16:20:23.98896469Z" level=info msg="time=\"2018-08-29T16:20:23.96144424Z\" level=debug msg=\"request end\" duration=\"684.963µs\" name=kata-agent pid=104 request=/grpc.AgentService/SignalProcess resp=\"&Empty{}\" sandbox=963ef7597ad2400ad6b37490a7bc28e6caf037a162e072618f3f69e76cacb583 source=agent\n" name=kata-proxy pid=14616 sandbox=963ef7597ad2400ad6b37490a7bc28e6caf037a162e072618f3f69e76cacb583 source=agent
time="2018-08-29T16:20:34.109310369Z" level=info msg="time=\"2018-08-29T16:20:34.083507929Z\" level=debug msg=\"request end\" duration=5.145933ms name=kata-agent pid=104 request=/grpc.AgentService/SignalProcess resp=\"&Empty{}\" sandbox=963ef7597ad2400ad6b37490a7bc28e6caf037a162e072618f3f69e76cacb583 source=agent\n" name=kata-proxy pid=14616 sandbox=963ef7597ad2400ad6b37490a7bc28e6caf037a162e072618f3f69e76cacb583 source=agent
time="2018-08-29T16:20:34.114300131Z" level=info msg="time=\"2018-08-29T16:20:34.088564684Z\" level=debug msg=\"request end\" duration=10m4.010200374s error=EOF name=kata-agent pid=104 request=/grpc.AgentService/ReadStdout resp= sandbox=963ef7597ad2400ad6b37490a7bc28e6caf037a162e072618f3f69e76cacb583 source=agent\n" name=kata-proxy pid=14616 sandbox=963ef7597ad2400ad6b37490a7bc28e6caf037a162e072618f3f69e76cacb583 source=agent
time="2018-08-29T16:20:34.12640814Z" level=info msg="time=\"2018-08-29T16:20:34.098367025Z\" level=debug msg=\"request end\" duration=10m2.933773542s error=EOF name=kata-agent pid=104 request=/grpc.AgentService/ReadStderr resp= sandbox=963ef7597ad2400ad6b37490a7bc28e6caf037a162e072618f3f69e76cacb583 source=agent\n" name=kata-proxy pid=14616 sandbox=963ef7597ad2400ad6b37490a7bc28e6caf037a162e072618f3f69e76cacb583 source=agent
time="2018-08-29T16:20:34.13314289Z" level=info msg="time=\"2018-08-29T16:20:34.106086244Z\" level=info msg=\"ignoring unexpected signal\" name=kata-agent pid=104 sandbox=963ef7597ad2400ad6b37490a7bc28e6caf037a162e072618f3f69e76cacb583 signal=\"child exited\" source=agent\n" name=kata-proxy pid=14616 sandbox=963ef7597ad2400ad6b37490a7bc28e6caf037a162e072618f3f69e76cacb583 source=agent
time="2018-08-29T16:20:34.273265337Z" level=info msg="time=\"2018-08-29T16:20:34.247428947Z\" level=debug msg=\"request end\" duration=2.327468ms name=kata-agent pid=104 request=/grpc.AgentService/SignalProcess resp=\"&Empty{}\" sandbox=963ef7597ad2400ad6b37490a7bc28e6caf037a162e072618f3f69e76cacb583 source=agent\n" name=kata-proxy pid=14616 sandbox=963ef7597ad2400ad6b37490a7bc28e6caf037a162e072618f3f69e76cacb583 source=agent
time="2018-08-29T16:20:34.318493597Z" level=info msg="time=\"2018-08-29T16:20:34.291697135Z\" level=debug msg=\"request end\" duration=1.867956ms name=kata-agent pid=104 request=/grpc.AgentService/RemoveContainer resp=\"&Empty{}\" sandbox=963ef7597ad2400ad6b37490a7bc28e6caf037a162e072618f3f69e76cacb583 source=agent\n" name=kata-proxy pid=14616 sandbox=963ef7597ad2400ad6b37490a7bc28e6caf037a162e072618f3f69e76cacb583 source=agent
time="2018-08-29T16:20:35.616127949Z" level=info msg="time=\"2018-08-29T16:20:35.590442546Z\" level=debug msg=\"request end\" duration=1.942983ms name=kata-agent pid=104 request=/grpc.AgentService/SignalProcess resp=\"&Empty{}\" sandbox=963ef7597ad2400ad6b37490a7bc28e6caf037a162e072618f3f69e76cacb583 source=agent\n" name=kata-proxy pid=14616 sandbox=963ef7597ad2400ad6b37490a7bc28e6caf037a162e072618f3f69e76cacb583 source=agent
time="2018-08-29T16:20:45.713480985Z" level=info msg="time=\"2018-08-29T16:20:45.683532384Z\" level=debug msg=\"request end\" duration=9.4814ms name=kata-agent pid=104 request=/grpc.AgentService/SignalProcess resp=\"&Empty{}\" sandbox=963ef7597ad2400ad6b37490a7bc28e6caf037a162e072618f3f69e76cacb583 source=agent\n" name=kata-proxy pid=14616 sandbox=963ef7597ad2400ad6b37490a7bc28e6caf037a162e072618f3f69e76cacb583 source=agent
time="2018-08-29T16:20:45.734996723Z" level=info msg="time=\"2018-08-29T16:20:45.70529375Z\" level=debug msg=\"request end\" duration=10m16.00283184s error=EOF name=kata-agent pid=104 request=/grpc.AgentService/ReadStdout resp= sandbox=963ef7597ad2400ad6b37490a7bc28e6caf037a162e072618f3f69e76cacb583 source=agent\n" name=kata-proxy pid=14616 sandbox=963ef7597ad2400ad6b37490a7bc28e6caf037a162e072618f3f69e76cacb583 source=agent
time="2018-08-29T16:20:45.735624618Z" level=info msg="time=\"2018-08-29T16:20:45.706077875Z\" level=debug msg=\"request end\" duration=10.09440167s error=EOF name=kata-agent pid=104 request=/grpc.AgentService/ReadStderr resp= sandbox=963ef7597ad2400ad6b37490a7bc28e6caf037a162e072618f3f69e76cacb583 source=agent\n" name=kata-proxy pid=14616 sandbox=963ef7597ad2400ad6b37490a7bc28e6caf037a162e072618f3f69e76cacb583 source=agent
time="2018-08-29T16:20:45.774495526Z" level=info msg="time=\"2018-08-29T16:20:45.738583858Z\" level=info msg=\"ignoring unexpected signal\" name=kata-agent pid=104 sandbox=963ef7597ad2400ad6b37490a7bc28e6caf037a162e072618f3f69e76cacb583 signal=\"child exited\" source=agent\n" name=kata-proxy pid=14616 sandbox=963ef7597ad2400ad6b37490a7bc28e6caf037a162e072618f3f69e76cacb583 source=agent
time="2018-08-29T16:20:45.836619959Z" level=info msg="time=\"2018-08-29T16:20:45.810702565Z\" level=debug msg=\"request end\" duration=\"645.085µs\" name=kata-agent pid=104 request=/grpc.AgentService/SignalProcess resp=\"&Empty{}\" sandbox=963ef7597ad2400ad6b37490a7bc28e6caf037a162e072618f3f69e76cacb583 source=agent\n" name=kata-proxy pid=14616 sandbox=963ef7597ad2400ad6b37490a7bc28e6caf037a162e072618f3f69e76cacb583 source=agent
time="2018-08-29T16:20:45.862475765Z" level=info msg="time=\"2018-08-29T16:20:45.831611206Z\" level=debug msg=\"request end\" duration=2.058608ms name=kata-agent pid=104 request=/grpc.AgentService/RemoveContainer resp=\"&Empty{}\" sandbox=963ef7597ad2400ad6b37490a7bc28e6caf037a162e072618f3f69e76cacb583 source=agent\n" name=kata-proxy pid=14616 sandbox=963ef7597ad2400ad6b37490a7bc28e6caf037a162e072618f3f69e76cacb583 source=agent
time="2018-08-29T16:21:49.010189128Z" level=info msg="time=\"2018-08-29T16:21:48.993804052Z\" level=debug msg=\"request end\" duration=1.023823ms name=kata-agent pid=104 request=/grpc.AgentService/SignalProcess resp=\"&Empty{}\" sandbox=7552dc0f155db6891e46ba661de689b6123d357ec30624ba435605ef47716f15 source=agent\n" name=kata-proxy pid=22533 sandbox=7552dc0f155db6891e46ba661de689b6123d357ec30624ba435605ef47716f15 source=agent
time="2018-08-29T16:21:49.013777701Z" level=info msg="time=\"2018-08-29T16:21:48.997557784Z\" level=debug msg=\"request end\" duration=6m26.096717417s error=EOF name=kata-agent pid=104 request=/grpc.AgentService/ReadStdout resp= sandbox=7552dc0f155db6891e46ba661de689b6123d357ec30624ba435605ef47716f15 source=agent\n" name=kata-proxy pid=22533 sandbox=7552dc0f155db6891e46ba661de689b6123d357ec30624ba435605ef47716f15 source=agent
time="2018-08-29T16:21:49.014573695Z" level=info msg="time=\"2018-08-29T16:21:48.998244995Z\" level=debug msg=\"request end\" duration=6m26.095892971s error=EOF name=kata-agent pid=104 request=/grpc.AgentService/ReadStderr resp= sandbox=7552dc0f155db6891e46ba661de689b6123d357ec30624ba435605ef47716f15 source=agent\n" name=kata-proxy pid=22533 sandbox=7552dc0f155db6891e46ba661de689b6123d357ec30624ba435605ef47716f15 source=agent
time="2018-08-29T16:21:49.016663479Z" level=info msg="time=\"2018-08-29T16:21:49.000510311Z\" level=info msg=\"ignoring unexpected signal\" name=kata-agent pid=104 sandbox=7552dc0f155db6891e46ba661de689b6123d357ec30624ba435605ef47716f15 signal=\"child exited\" source=agent\n" name=kata-proxy pid=22533 sandbox=7552dc0f155db6891e46ba661de689b6123d357ec30624ba435605ef47716f15 source=agent
time="2018-08-29T16:21:49.128104641Z" level=info msg="time=\"2018-08-29T16:21:49.111643751Z\" level=debug msg=\"request end\" duration=1.021627ms name=kata-agent pid=104 request=/grpc.AgentService/SignalProcess resp=\"&Empty{}\" sandbox=7552dc0f155db6891e46ba661de689b6123d357ec30624ba435605ef47716f15 source=agent\n" name=kata-proxy pid=22533 sandbox=7552dc0f155db6891e46ba661de689b6123d357ec30624ba435605ef47716f15 source=agent
time="2018-08-29T16:21:49.1336048Z" level=info msg="time=\"2018-08-29T16:21:49.11742116Z\" level=debug msg=\"request end\" duration=1.696379ms name=kata-agent pid=104 request=/grpc.AgentService/RemoveContainer resp=\"&Empty{}\" sandbox=7552dc0f155db6891e46ba661de689b6123d357ec30624ba435605ef47716f15 source=agent\n" name=kata-proxy pid=22533 sandbox=7552dc0f155db6891e46ba661de689b6123d357ec30624ba435605ef47716f15 source=agent
time="2018-08-29T16:21:49.216825074Z" level=info msg="time=\"2018-08-29T16:21:49.200716385Z\" level=debug msg=\"request end\" duration=6.469109ms name=kata-agent pid=104 request=/grpc.AgentService/DestroySandbox resp=\"&Empty{}\" sandbox=7552dc0f155db6891e46ba661de689b6123d357ec30624ba435605ef47716f15 source=agent\n" name=kata-proxy pid=22533 sandbox=7552dc0f155db6891e46ba661de689b6123d357ec30624ba435605ef47716f15 source=agent
time="2018-08-29T16:21:49.21863196Z" level=fatal msg="failed to handle exit signal" error="close unix @->/run/vc/vm/7552dc0f155db6891e46ba661de689b6123d357ec30624ba435605ef47716f15/kata.sock: use of closed network connection" name=kata-proxy pid=22533 sandbox=7552dc0f155db6891e46ba661de689b6123d357ec30624ba435605ef47716f15 source=proxy
time="2018-08-29T16:21:49.772150597Z" level=info msg="time=\"2018-08-29T16:21:49.74632119Z\" level=debug msg=\"request end\" duration=\"471.767µs\" name=kata-agent pid=104 request=/grpc.AgentService/SignalProcess resp=\"&Empty{}\" sandbox=963ef7597ad2400ad6b37490a7bc28e6caf037a162e072618f3f69e76cacb583 source=agent\n" name=kata-proxy pid=14616 sandbox=963ef7597ad2400ad6b37490a7bc28e6caf037a162e072618f3f69e76cacb583 source=agent
time="2018-08-29T16:21:49.774259781Z" level=info msg="time=\"2018-08-29T16:21:49.748510737Z\" level=debug msg=\"request end\" duration=11m20.336154162s error=EOF name=kata-agent pid=104 request=/grpc.AgentService/ReadStdout resp= sandbox=963ef7597ad2400ad6b37490a7bc28e6caf037a162e072618f3f69e76cacb583 source=agent\n" name=kata-proxy pid=14616 sandbox=963ef7597ad2400ad6b37490a7bc28e6caf037a162e072618f3f69e76cacb583 source=agent
time="2018-08-29T16:21:49.774608278Z" level=info msg="time=\"2018-08-29T16:21:49.748985305Z\" level=debug msg=\"request end\" duration=11m20.317022529s error=EOF name=kata-agent pid=104 request=/grpc.AgentService/ReadStderr resp= sandbox=963ef7597ad2400ad6b37490a7bc28e6caf037a162e072618f3f69e76cacb583 source=agent\n" name=kata-proxy pid=14616 sandbox=963ef7597ad2400ad6b37490a7bc28e6caf037a162e072618f3f69e76cacb583 source=agent
time="2018-08-29T16:21:49.775592971Z" level=info msg="time=\"2018-08-29T16:21:49.749847946Z\" level=info msg=\"ignoring unexpected signal\" name=kata-agent pid=104 sandbox=963ef7597ad2400ad6b37490a7bc28e6caf037a162e072618f3f69e76cacb583 signal=\"child exited\" source=agent\n" name=kata-proxy pid=14616 sandbox=963ef7597ad2400ad6b37490a7bc28e6caf037a162e072618f3f69e76cacb583 source=agent
time="2018-08-29T16:21:49.785175599Z" level=info msg="time=\"2018-08-29T16:21:49.75957297Z\" level=debug msg=\"request end\" duration=\"525.468µs\" name=kata-agent pid=104 request=/grpc.AgentService/SignalProcess resp=\"&Empty{}\" sandbox=963ef7597ad2400ad6b37490a7bc28e6caf037a162e072618f3f69e76cacb583 source=agent\n" name=kata-proxy pid=14616 sandbox=963ef7597ad2400ad6b37490a7bc28e6caf037a162e072618f3f69e76cacb583 source=agent
time="2018-08-29T16:21:49.787113484Z" level=debug msg="Copy stream error" error="read unix /run/vc/sbs/963ef7597ad2400ad6b37490a7bc28e6caf037a162e072618f3f69e76cacb583/proxy.sock->@: read: connection reset by peer" name=kata-proxy pid=14616 sandbox=963ef7597ad2400ad6b37490a7bc28e6caf037a162e072618f3f69e76cacb583 source=proxy
time="2018-08-29T16:21:49.791024755Z" level=info msg="time=\"2018-08-29T16:21:49.765350859Z\" level=debug msg=\"request end\" duration=\"604.588µs\" name=kata-agent pid=104 request=/grpc.AgentService/RemoveContainer resp=\"&Empty{}\" sandbox=963ef7597ad2400ad6b37490a7bc28e6caf037a162e072618f3f69e76cacb583 source=agent\n" name=kata-proxy pid=14616 sandbox=963ef7597ad2400ad6b37490a7bc28e6caf037a162e072618f3f69e76cacb583 source=agent
time="2018-08-29T16:21:49.881283276Z" level=info msg="time=\"2018-08-29T16:21:49.855618642Z\" level=debug msg=\"request end\" duration=6.767872ms name=kata-agent pid=104 request=/grpc.AgentService/DestroySandbox resp=\"&Empty{}\" sandbox=963ef7597ad2400ad6b37490a7bc28e6caf037a162e072618f3f69e76cacb583 source=agent\n" name=kata-proxy pid=14616 sandbox=963ef7597ad2400ad6b37490a7bc28e6caf037a162e072618f3f69e76cacb583 source=agent
time="2018-08-29T16:21:49.882955963Z" level=fatal msg="failed to handle exit signal" error="close unix @->/run/vc/vm/963ef7597ad2400ad6b37490a7bc28e6caf037a162e072618f3f69e76cacb583/kata.sock: use of closed network connection" name=kata-proxy pid=14616 sandbox=963ef7597ad2400ad6b37490a7bc28e6caf037a162e072618f3f69e76cacb583 source=proxy

Shim logs

Recent shim problems found in system journal:

time="2018-08-29T15:59:53.354311453Z" level=info msg="copy stdout failed" container=62ef318477f4b97b953672182faeb8a0ff4b62dd773b43ce51454d77a0242c96 error="rpc error: code = Unknown desc = read /dev/ptmx: input/output error" exec-id=62ef318477f4b97b953672182faeb8a0ff4b62dd773b43ce51454d77a0242c96 name=kata-shim pid=1 source=shim
time="2018-08-29T15:59:53.361378205Z" level=info msg="copy stdout failed" container=acaa8925c2730369fbe710db9502e065461de56f480a9df8f1cc868ac30149bd error="rpc error: code = Unknown desc = read /dev/ptmx: input/output error" exec-id=acaa8925c2730369fbe710db9502e065461de56f480a9df8f1cc868ac30149bd name=kata-shim pid=1 source=shim
time="2018-08-29T15:59:53.36360689Z" level=info msg="copy stdout failed" container=71a6facd0dead12fc62135b5557b545b4fb287df88810b881cb4befd012d4e35 error="rpc error: code = Unknown desc = read /dev/ptmx: input/output error" exec-id=71a6facd0dead12fc62135b5557b545b4fb287df88810b881cb4befd012d4e35 name=kata-shim pid=1 source=shim
time="2018-08-29T15:59:53.366045173Z" level=info msg="copy stdout failed" container=fef3cbfc548f4f35ed41c859e25fcaa4791c82365000c700bc47e9ba48116867 error="rpc error: code = Unknown desc = read /dev/ptmx: input/output error" exec-id=fef3cbfc548f4f35ed41c859e25fcaa4791c82365000c700bc47e9ba48116867 name=kata-shim pid=1 source=shim
time="2018-08-29T15:59:53.382314862Z" level=info msg="copy stdout failed" container=5a0471ef2a2fa0deffe53cbc6f7e23102936e88af85a061a8b2e9f397646c09f error="rpc error: code = Unknown desc = read /dev/ptmx: input/output error" exec-id=5a0471ef2a2fa0deffe53cbc6f7e23102936e88af85a061a8b2e9f397646c09f name=kata-shim pid=1 source=shim
time="2018-08-29T15:59:53.386904731Z" level=info msg="copy stdout failed" container=05421182a009473ad683d0fc737d3f4dbbe0c4d7f9d4ae576d677a82cff6ea09 error="rpc error: code = Unknown desc = read /dev/ptmx: input/output error" exec-id=05421182a009473ad683d0fc737d3f4dbbe0c4d7f9d4ae576d677a82cff6ea09 name=kata-shim pid=1 source=shim
time="2018-08-29T15:59:53.388938417Z" level=info msg="copy stdout failed" container=72ed291195329c2ba20c80facaa290012c02ad3d4a4205322ebad25527613807 error="rpc error: code = Unknown desc = read /dev/ptmx: input/output error" exec-id=72ed291195329c2ba20c80facaa290012c02ad3d4a4205322ebad25527613807 name=kata-shim pid=1 source=shim
time="2018-08-29T15:59:53.396669464Z" level=info msg="copy stdout failed" container=dfab386ccf04938a4edc3f45ca02890dc441432c8dbd3dfe820592ac5f3d59ff error="rpc error: code = Unknown desc = read /dev/ptmx: input/output error" exec-id=dfab386ccf04938a4edc3f45ca02890dc441432c8dbd3dfe820592ac5f3d59ff name=kata-shim pid=1 source=shim
time="2018-08-29T15:59:53.399320946Z" level=info msg="copy stdout failed" container=85e21fd91e5544da021d2c1e02037e9d13791d39b761a302dd35b6f377babd9a error="rpc error: code = Unknown desc = read /dev/ptmx: input/output error" exec-id=85e21fd91e5544da021d2c1e02037e9d13791d39b761a302dd35b6f377babd9a name=kata-shim pid=1 source=shim
time="2018-08-29T15:59:53.416554829Z" level=info msg="copy stdout failed" container=86d3d71a34d80070a6bc58df22ccc808cef97636bff9d1b44ee44b7e996ffb2a error="rpc error: code = Unknown desc = read /dev/ptmx: input/output error" exec-id=86d3d71a34d80070a6bc58df22ccc808cef97636bff9d1b44ee44b7e996ffb2a name=kata-shim pid=1 source=shim
time="2018-08-29T15:59:53.430760432Z" level=info msg="copy stdout failed" container=4263679d0bc6c3f42caade5cc0ad747730550e3dfb0b9bd4111dc1c2768c556f error="rpc error: code = Unknown desc = read /dev/ptmx: input/output error" exec-id=4263679d0bc6c3f42caade5cc0ad747730550e3dfb0b9bd4111dc1c2768c556f name=kata-shim pid=1 source=shim
time="2018-08-29T15:59:53.497626176Z" level=info msg="copy stdout failed" container=3043db0740990401b1371b849f65c084f56322d78990e78a7244b0b06f739a98 error="rpc error: code = Unknown desc = read /dev/ptmx: input/output error" exec-id=3043db0740990401b1371b849f65c084f56322d78990e78a7244b0b06f739a98 name=kata-shim pid=1 source=shim
time="2018-08-29T15:59:53.501605149Z" level=info msg="copy stdout failed" container=7e1ea6d035eeba009946d1bb4ab57212d8ac4211b4fb3a027ae64b20a47da5fe error="rpc error: code = Unknown desc = read /dev/ptmx: input/output error" exec-id=7e1ea6d035eeba009946d1bb4ab57212d8ac4211b4fb3a027ae64b20a47da5fe name=kata-shim pid=1 source=shim
time="2018-08-29T15:59:53.548677929Z" level=info msg="copy stdout failed" container=0c9b698b45fd5a67bf9217c99d27c68416e57682fa49aa615b677f5d8a95a5fe error="rpc error: code = Unknown desc = read /dev/ptmx: input/output error" exec-id=0c9b698b45fd5a67bf9217c99d27c68416e57682fa49aa615b677f5d8a95a5fe name=kata-shim pid=1 source=shim
time="2018-08-29T15:59:53.570604679Z" level=info msg="copy stdout failed" container=e7c7303fa0bea584a309c46a18e47205f36084ff7b4d58fa2139d8efdaf75d39 error="rpc error: code = Unknown desc = read /dev/ptmx: input/output error" exec-id=e7c7303fa0bea584a309c46a18e47205f36084ff7b4d58fa2139d8efdaf75d39 name=kata-shim pid=1 source=shim
time="2018-08-29T15:59:53.605048144Z" level=info msg="copy stdout failed" container=cafd820fa488c2082bceb046125166f7564e21b03a57a9ab3a9a2dcfae2451d5 error="rpc error: code = Unknown desc = read /dev/ptmx: input/output error" exec-id=cafd820fa488c2082bceb046125166f7564e21b03a57a9ab3a9a2dcfae2451d5 name=kata-shim pid=1 source=shim
time="2018-08-29T15:59:53.620194241Z" level=info msg="copy stdout failed" container=c9839d576e565e518d5d895cd17aa3daec8e29858179418b5d2a13ad7a8428f2 error="rpc error: code = Unknown desc = read /dev/ptmx: input/output error" exec-id=c9839d576e565e518d5d895cd17aa3daec8e29858179418b5d2a13ad7a8428f2 name=kata-shim pid=1 source=shim
time="2018-08-29T15:59:53.624260314Z" level=info msg="copy stdout failed" container=d94f0595f52a37307544b9e6f1b9369f8e2d73b8d9e2b22b7dacd859ec8c010f error="rpc error: code = Unknown desc = read /dev/ptmx: input/output error" exec-id=d94f0595f52a37307544b9e6f1b9369f8e2d73b8d9e2b22b7dacd859ec8c010f name=kata-shim pid=1 source=shim
time="2018-08-29T16:06:46.304344181Z" level=info msg="Error getting window size" container=6543225c3c95c1f10d852c8f7426ce55d78ca6673aa7c0336e958820b86f1c82 error="inappropriate ioctl for device" exec-id=6543225c3c95c1f10d852c8f7426ce55d78ca6673aa7c0336e958820b86f1c82 fd=0 name=kata-shim pid=1 source=shim
time="2018-08-29T16:06:49.83513552Z" level=info msg="Error getting window size" container=7fce943af3f1d3a979034c79e3e78eb2eed231ee05c565001c02d0611d314438 error="inappropriate ioctl for device" exec-id=7fce943af3f1d3a979034c79e3e78eb2eed231ee05c565001c02d0611d314438 fd=0 name=kata-shim pid=1 source=shim
time="2018-08-29T16:06:53.84516928Z" level=info msg="Error getting window size" container=1f398e1d79979dee5e2afa29c2992380c291cfcda7d1b5031fdf54290fce8c06 error="inappropriate ioctl for device" exec-id=1f398e1d79979dee5e2afa29c2992380c291cfcda7d1b5031fdf54290fce8c06 fd=0 name=kata-shim pid=1 source=shim
time="2018-08-29T16:06:56.460178936Z" level=info msg="Error getting window size" container=62ea93f8fe52549ed51e3fd75ce99b5a47fa9168c2bb5a39705503820d06d2b6 error="inappropriate ioctl for device" exec-id=62ea93f8fe52549ed51e3fd75ce99b5a47fa9168c2bb5a39705503820d06d2b6 fd=0 name=kata-shim pid=1 source=shim
time="2018-08-29T16:10:29.422432621Z" level=info msg="Error getting window size" container=963ef7597ad2400ad6b37490a7bc28e6caf037a162e072618f3f69e76cacb583 error="inappropriate ioctl for device" exec-id=963ef7597ad2400ad6b37490a7bc28e6caf037a162e072618f3f69e76cacb583 fd=0 name=kata-shim pid=1 source=shim
time="2018-08-29T16:10:29.717645849Z" level=info msg="Error getting window size" container=d0f4698739beb7198f0afb42757c4fd4895595f102f5bc3d61120d72695244ee error="inappropriate ioctl for device" exec-id=d0f4698739beb7198f0afb42757c4fd4895595f102f5bc3d61120d72695244ee fd=0 name=kata-shim pid=1 source=shim
time="2018-08-29T16:10:30.092043993Z" level=info msg="Error getting window size" container=a98174fe74ca3e47e3c4be458a9d4e67dee6ab19a4ebf2bf36b9311bcec0c2f4 error="inappropriate ioctl for device" exec-id=a98174fe74ca3e47e3c4be458a9d4e67dee6ab19a4ebf2bf36b9311bcec0c2f4 fd=0 name=kata-shim pid=1 source=shim
time="2018-08-29T16:10:30.469250517Z" level=info msg="Error getting window size" container=4984a17848468edce745a4bfa1d9edbc3026aa14792c42f591ff87403139b85f error="inappropriate ioctl for device" exec-id=4984a17848468edce745a4bfa1d9edbc3026aa14792c42f591ff87403139b85f fd=0 name=kata-shim pid=1 source=shim
time="2018-08-29T16:11:00.297666703Z" level=info msg="Error getting window size" container=a610cf52cf24cc5fcce1aafdaa90a5453a41ef46be5b8bcfaaeea122ade43338 error="inappropriate ioctl for device" exec-id=a610cf52cf24cc5fcce1aafdaa90a5453a41ef46be5b8bcfaaeea122ade43338 fd=0 name=kata-shim pid=1 source=shim
time="2018-08-29T16:11:00.514567804Z" level=info msg="Error getting window size" container=7d661ffdbfbd9b79bff552382def3b1b0cb94fdb0ac6b6853a17fba5ab9638e5 error="inappropriate ioctl for device" exec-id=7d661ffdbfbd9b79bff552382def3b1b0cb94fdb0ac6b6853a17fba5ab9638e5 fd=0 name=kata-shim pid=1 source=shim
time="2018-08-29T16:11:00.695942767Z" level=info msg="Error getting window size" container=7b755601c154dce9387c8ad8e8658890474143b70d9f9cfc849033dad9be3cb1 error="inappropriate ioctl for device" exec-id=7b755601c154dce9387c8ad8e8658890474143b70d9f9cfc849033dad9be3cb1 fd=0 name=kata-shim pid=1 source=shim
time="2018-08-29T16:11:00.87864212Z" level=info msg="Error getting window size" container=11410582f9d9888cc95196132621cae5a24cd8ad2e61732df8e89df85dcf78b4 error="inappropriate ioctl for device" exec-id=11410582f9d9888cc95196132621cae5a24cd8ad2e61732df8e89df85dcf78b4 fd=0 name=kata-shim pid=1 source=shim
time="2018-08-29T16:11:11.253971807Z" level=info msg="Error getting window size" container=a58b3bff1ff2be8a66cfc757d8cc6420dbb4db3bf8d8c1d4838086ff8046672d error="inappropriate ioctl for device" exec-id=a58b3bff1ff2be8a66cfc757d8cc6420dbb4db3bf8d8c1d4838086ff8046672d fd=0 name=kata-shim pid=1 source=shim
time="2018-08-29T16:11:11.594150998Z" level=info msg="Error getting window size" container=c789e7eb6a3a5a15f53c3cd735ddb7edf3ee87201882301ec20917ba614d77f4 error="inappropriate ioctl for device" exec-id=c789e7eb6a3a5a15f53c3cd735ddb7edf3ee87201882301ec20917ba614d77f4 fd=0 name=kata-shim pid=1 source=shim
time="2018-08-29T16:13:12.175813329Z" level=info msg="Error getting window size" container=83d7555f432f2e1bb969f12b716eeea49ac00ed5439fed5c454dc899b282fbda error="inappropriate ioctl for device" exec-id=83d7555f432f2e1bb969f12b716eeea49ac00ed5439fed5c454dc899b282fbda fd=0 name=kata-shim pid=1 source=shim
time="2018-08-29T16:13:15.086702831Z" level=info msg="Error getting window size" container=592a8cc9b10e2d1bf975c3b7b10634ded47c38a5fa7f4c55c7dc2854f0bb03f5 error="inappropriate ioctl for device" exec-id=592a8cc9b10e2d1bf975c3b7b10634ded47c38a5fa7f4c55c7dc2854f0bb03f5 fd=0 name=kata-shim pid=1 source=shim
time="2018-08-29T16:13:23.591914108Z" level=info msg="Error getting window size" container=3015463b7faee365658b9c187df001d374027f1d7d4774fdcf51d1b65ee8ba49 error="inappropriate ioctl for device" exec-id=3015463b7faee365658b9c187df001d374027f1d7d4774fdcf51d1b65ee8ba49 fd=0 name=kata-shim pid=1 source=shim
time="2018-08-29T16:13:28.733600238Z" level=info msg="Error getting window size" container=47a8b78814fa03619b816968d3ed6c2b9d5cd92085ad6ec81867ccf6743ed63c error="inappropriate ioctl for device" exec-id=47a8b78814fa03619b816968d3ed6c2b9d5cd92085ad6ec81867ccf6743ed63c fd=0 name=kata-shim pid=1 source=shim
time="2018-08-29T16:13:30.726917538Z" level=info msg="Error getting window size" container=592a8cc9b10e2d1bf975c3b7b10634ded47c38a5fa7f4c55c7dc2854f0bb03f5 error="inappropriate ioctl for device" exec-id=5a75a922-4b72-437a-a968-1ac6fa0c7041 fd=0 name=kata-shim pid=10 source=shim
time="2018-08-29T16:13:30.944511622Z" level=info msg="Error getting window size" container=47a8b78814fa03619b816968d3ed6c2b9d5cd92085ad6ec81867ccf6743ed63c error="inappropriate ioctl for device" exec-id=a984eed7-6d8f-4378-80dc-85dc8dc04383 fd=0 name=kata-shim pid=11 source=shim
time="2018-08-29T16:13:31.186218027Z" level=info msg="Error getting window size" container=592a8cc9b10e2d1bf975c3b7b10634ded47c38a5fa7f4c55c7dc2854f0bb03f5 error="inappropriate ioctl for device" exec-id=083fb58c-903b-457a-95fa-1fa46cc2cd0b fd=0 name=kata-shim pid=20 source=shim
time="2018-08-29T16:13:31.43898125Z" level=info msg="Error getting window size" container=47a8b78814fa03619b816968d3ed6c2b9d5cd92085ad6ec81867ccf6743ed63c error="inappropriate ioctl for device" exec-id=d4b31d9d-c019-4793-94c9-7ea578c00719 fd=0 name=kata-shim pid=22 source=shim
time="2018-08-29T16:15:22.875363246Z" level=info msg="Error getting window size" container=7552dc0f155db6891e46ba661de689b6123d357ec30624ba435605ef47716f15 error="inappropriate ioctl for device" exec-id=7552dc0f155db6891e46ba661de689b6123d357ec30624ba435605ef47716f15 fd=0 name=kata-shim pid=1 source=shim
time="2018-08-29T16:15:26.114136098Z" level=info msg="Error getting window size" container=0dfbce013fb6e558cbe26d7c9d71ba53a24687f2bf9f965ccb3429cc9b1a04bb error="inappropriate ioctl for device" exec-id=0dfbce013fb6e558cbe26d7c9d71ba53a24687f2bf9f965ccb3429cc9b1a04bb fd=0 name=kata-shim pid=1 source=shim
time="2018-08-29T16:15:29.063233007Z" level=info msg="Error getting window size" container=0dfbce013fb6e558cbe26d7c9d71ba53a24687f2bf9f965ccb3429cc9b1a04bb error="inappropriate ioctl for device" exec-id=1301812a-f61b-49cc-bf2e-3175031469c7 fd=0 name=kata-shim pid=12 source=shim
time="2018-08-29T16:15:29.356832118Z" level=info msg="Error getting window size" container=0dfbce013fb6e558cbe26d7c9d71ba53a24687f2bf9f965ccb3429cc9b1a04bb error="inappropriate ioctl for device" exec-id=0d2f2b33-a276-4fd2-b488-15f5f1cfd64f fd=0 name=kata-shim pid=26 source=shim
time="2018-08-29T16:15:29.660319354Z" level=info msg="Error getting window size" container=0dfbce013fb6e558cbe26d7c9d71ba53a24687f2bf9f965ccb3429cc9b1a04bb error="inappropriate ioctl for device" exec-id=eb3ec66d-c435-4171-96d1-0bff565e4595 fd=0 name=kata-shim pid=35 source=shim
time="2018-08-29T16:15:29.967863861Z" level=info msg="Error getting window size" container=0dfbce013fb6e558cbe26d7c9d71ba53a24687f2bf9f965ccb3429cc9b1a04bb error="inappropriate ioctl for device" exec-id=b46e01e5-fda9-4b10-b822-d607e5bc6734 fd=0 name=kata-shim pid=45 source=shim
time="2018-08-29T16:15:59.914136035Z" level=info msg="Error getting window size" container=89a79decac159ac3552f92018ed1c49e4eaf9ee731110e95405bad8c9512dde5 error="inappropriate ioctl for device" exec-id=89a79decac159ac3552f92018ed1c49e4eaf9ee731110e95405bad8c9512dde5 fd=0 name=kata-shim pid=1 source=shim
time="2018-08-29T16:16:46.349933684Z" level=info msg="Error getting window size" container=ee0b92bca44f9cc0c24c96fd05f40419911cea85cb6855daf499d86a7b702562 error="inappropriate ioctl for device" exec-id=ee0b92bca44f9cc0c24c96fd05f40419911cea85cb6855daf499d86a7b702562 fd=0 name=kata-shim pid=1 source=shim
time="2018-08-29T16:17:32.683251155Z" level=info msg="Error getting window size" container=6055cfd6b9ffdb418b53838d822955114fb3b6ecc271ac56d6171a286c077d99 error="inappropriate ioctl for device" exec-id=6055cfd6b9ffdb418b53838d822955114fb3b6ecc271ac56d6171a286c077d99 fd=0 name=kata-shim pid=1 source=shim
time="2018-08-29T16:17:38.433779117Z" level=info msg="Error getting window size" container=b9e0b8e1d7ca57b33c48880b92e76eda52b6a97579385075c725b65f80eac4dc error="inappropriate ioctl for device" exec-id=b9e0b8e1d7ca57b33c48880b92e76eda52b6a97579385075c725b65f80eac4dc fd=0 name=kata-shim pid=1 source=shim

Container manager details

Have docker

Docker

Output of "docker version":

Client:
 Version:           18.06.0-ce
 API version:       1.38
 Go version:        go1.10.3
 Git commit:        0ffa825
 Built:             Wed Jul 18 19:11:02 2018
 OS/Arch:           linux/amd64
 Experimental:      false

Server:
 Engine:
  Version:          18.06.0-ce
  API version:      1.38 (minimum version 1.12)
  Go version:       go1.10.3
  Git commit:       0ffa825
  Built:            Wed Jul 18 19:09:05 2018
  OS/Arch:          linux/amd64
  Experimental:     false

Output of "docker info":

Containers: 1
 Running: 0
 Paused: 0
 Stopped: 1
Images: 49
Server Version: 18.06.0-ce
Storage Driver: overlay2
 Backing Filesystem: extfs
 Supports d_type: true
 Native Overlay Diff: false
Logging Driver: json-file
Cgroup Driver: cgroupfs
Plugins:
 Volume: local
 Network: bridge host macvlan null overlay
 Log: awslogs fluentd gcplogs gelf journald json-file logentries splunk syslog
Swarm: inactive
Runtimes: kata-runtime runc
Default Runtime: kata-runtime
Init Binary: docker-init
containerd version: d64c661f1d51c48782c9cec8fda7604785f93587
runc version: a3038924fbf93bb59220ab9d33de667d29ffceab (expected: 69663f0bd4b60df09991c08812a60108003fa340)
init version: fec3683
Security Options:
 apparmor
 seccomp
  Profile: default
Kernel Version: 4.15.0-1021-azure
Operating System: Ubuntu 16.04.5 LTS
OSType: linux
Architecture: x86_64
CPUs: 4
Total Memory: 15.67GiB
Name: gabyubuntu
ID: XO5W:QTCU:VJ4Z:QJFW:E6Q6:XXQJ:ORD5:5SZN:6SVI:2NLV:5XOK:ULNC
Docker Root Dir: /var/lib/docker
Debug Mode (client): false
Debug Mode (server): true
 File Descriptors: 24
 Goroutines: 44
 System Time: 2018-08-29T16:47:32.279234161Z
 EventsListeners: 0
Registry: https://index.docker.io/v1/
Labels:
Experimental: false
Insecure Registries:
 127.0.0.0/8
Live Restore Enabled: false

WARNING: No swap limit support

Output of "systemctl show docker":

Type=notify
Restart=on-failure
NotifyAccess=main
RestartUSec=100ms
TimeoutStartUSec=infinity
TimeoutStopUSec=1min 30s
RuntimeMaxUSec=infinity
WatchdogUSec=0
WatchdogTimestamp=Thu 2018-08-23 18:23:03 UTC
WatchdogTimestampMonotonic=506443812835
FailureAction=none
PermissionsStartOnly=no
RootDirectoryStartOnly=no
RemainAfterExit=no
GuessMainPID=yes
MainPID=6658
ControlPID=0
FileDescriptorStoreMax=0
NFileDescriptorStore=0
StatusErrno=0
Result=success
ExecMainStartTimestamp=Thu 2018-08-23 18:23:03 UTC
ExecMainStartTimestampMonotonic=506443338286
ExecMainExitTimestampMonotonic=0
ExecMainPID=6658
ExecMainCode=0
ExecMainStatus=0
ExecStart={ path=/usr/bin/dockerd ; argv[]=/usr/bin/dockerd -D --add-runtime kata-runtime=/usr/local/bin/kata-runtime --default-runtime=kata-runtime ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }
ExecReload={ path=/bin/kill ; argv[]=/bin/kill -s HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }
Slice=system.slice
ControlGroup=/system.slice/docker.service
MemoryCurrent=205062144
CPUUsageNSec=11325617829052
TasksCurrent=96
Delegate=yes
CPUAccounting=no
CPUShares=18446744073709551615
StartupCPUShares=18446744073709551615
CPUQuotaPerSecUSec=infinity
BlockIOAccounting=no
BlockIOWeight=18446744073709551615
StartupBlockIOWeight=18446744073709551615
MemoryAccounting=no
MemoryLimit=18446744073709551615
DevicePolicy=auto
TasksAccounting=no
TasksMax=18446744073709551615
UMask=0022
LimitCPU=18446744073709551615
LimitCPUSoft=18446744073709551615
LimitFSIZE=18446744073709551615
LimitFSIZESoft=18446744073709551615
LimitDATA=18446744073709551615
LimitDATASoft=18446744073709551615
LimitSTACK=18446744073709551615
LimitSTACKSoft=8388608
LimitCORE=18446744073709551615
LimitCORESoft=18446744073709551615
LimitRSS=18446744073709551615
LimitRSSSoft=18446744073709551615
LimitNOFILE=1048576
LimitNOFILESoft=1048576
LimitAS=18446744073709551615
LimitASSoft=18446744073709551615
LimitNPROC=18446744073709551615
LimitNPROCSoft=18446744073709551615
LimitMEMLOCK=65536
LimitMEMLOCKSoft=65536
LimitLOCKS=18446744073709551615
LimitLOCKSSoft=18446744073709551615
LimitSIGPENDING=64083
LimitSIGPENDINGSoft=64083
LimitMSGQUEUE=819200
LimitMSGQUEUESoft=819200
LimitNICE=0
LimitNICESoft=0
LimitRTPRIO=0
LimitRTPRIOSoft=0
LimitRTTIME=18446744073709551615
LimitRTTIMESoft=18446744073709551615
OOMScoreAdjust=0
Nice=0
IOScheduling=0
CPUSchedulingPolicy=0
CPUSchedulingPriority=0
TimerSlackNSec=50000
CPUSchedulingResetOnFork=no
NonBlocking=no
StandardInput=null
StandardOutput=journal
StandardError=inherit
TTYReset=no
TTYVHangup=no
TTYVTDisallocate=no
SyslogPriority=30
SyslogLevelPrefix=yes
SyslogLevel=6
SyslogFacility=3
SecureBits=0
CapabilityBoundingSet=18446744073709551615
AmbientCapabilities=0
MountFlags=0
PrivateTmp=no
PrivateNetwork=no
PrivateDevices=no
ProtectHome=no
ProtectSystem=no
SameProcessGroup=no
UtmpMode=init
IgnoreSIGPIPE=yes
NoNewPrivileges=no
SystemCallErrorNumber=0
RuntimeDirectoryMode=0755
KillMode=process
KillSignal=15
SendSIGKILL=yes
SendSIGHUP=no
Id=docker.service
Names=docker.service
Requires=sysinit.target docker.socket system.slice
Wants=network-online.target
WantedBy=multi-user.target
ConsistsOf=docker.socket
Conflicts=shutdown.target
Before=shutdown.target multi-user.target
After=system.slice sysinit.target docker.socket firewalld.service network-online.target systemd-journald.socket basic.target
TriggeredBy=docker.socket
Documentation=https://docs.docker.com
Description=Docker Application Container Engine
LoadState=loaded
ActiveState=active
SubState=running
FragmentPath=/lib/systemd/system/docker.service
DropInPaths=/etc/systemd/system/docker.service.d/kata-containers.conf
UnitFileState=enabled
UnitFilePreset=enabled
StateChangeTimestamp=Thu 2018-08-23 18:23:03 UTC
StateChangeTimestampMonotonic=506443812836
InactiveExitTimestamp=Thu 2018-08-23 18:23:03 UTC
InactiveExitTimestampMonotonic=506443338338
ActiveEnterTimestamp=Thu 2018-08-23 18:23:03 UTC
ActiveEnterTimestampMonotonic=506443812836
ActiveExitTimestamp=Thu 2018-08-23 18:23:02 UTC
ActiveExitTimestampMonotonic=506442265558
InactiveEnterTimestamp=Thu 2018-08-23 18:23:03 UTC
InactiveEnterTimestampMonotonic=506443332126
CanStart=yes
CanStop=yes
CanReload=yes
CanIsolate=no
StopWhenUnneeded=no
RefuseManualStart=no
RefuseManualStop=no
AllowIsolate=no
DefaultDependencies=yes
OnFailureJobMode=replace
IgnoreOnIsolate=no
NeedDaemonReload=no
JobTimeoutUSec=infinity
JobTimeoutAction=none
ConditionResult=yes
AssertResult=yes
ConditionTimestamp=Thu 2018-08-23 18:23:03 UTC
ConditionTimestampMonotonic=506443337259
AssertTimestamp=Thu 2018-08-23 18:23:03 UTC
AssertTimestampMonotonic=506443337260
Transient=no
StartLimitInterval=60000000
StartLimitBurst=3
StartLimitAction=none

Have kubectl

Kubernetes

Output of "kubectl version":

Client Version: version.Info{Major:"1", Minor:"10", GitVersion:"v1.10.5", GitCommit:"32ac1c9073b132b8ba18aa830f46b77dcceb0723", GitTreeState:"clean", BuildDate:"2018-06-21T11:46:00Z", GoVersion:"go1.9.3", Compiler:"gc", Platform:"linux/amd64"}
The connection to the server localhost:8080 was refused - did you specify the right host or port?

Output of "kubectl config view":

apiVersion: v1
clusters: []
contexts: []
current-context: ""
kind: Config
preferences: {}
users: []

Output of "systemctl show kubelet":

Type=simple
Restart=always
NotifyAccess=none
RestartUSec=10s
TimeoutStartUSec=1min 30s
TimeoutStopUSec=1min 30s
RuntimeMaxUSec=infinity
WatchdogUSec=0
WatchdogTimestampMonotonic=0
FailureAction=none
PermissionsStartOnly=no
RootDirectoryStartOnly=no
RemainAfterExit=no
GuessMainPID=yes
MainPID=0
ControlPID=0
FileDescriptorStoreMax=0
NFileDescriptorStore=0
StatusErrno=0
Result=success
ExecMainStartTimestamp=Wed 2018-08-29 16:09:38 UTC
ExecMainStartTimestampMonotonic=1016839126837
ExecMainExitTimestamp=Wed 2018-08-29 16:17:45 UTC
ExecMainExitTimestampMonotonic=1017325604705
ExecMainPID=13083
ExecMainCode=2
ExecMainStatus=15
ExecStart={ path=/usr/bin/kubelet ; argv[]=/usr/bin/kubelet $KUBELET_KUBECONFIG_ARGS $KUBELET_SYSTEM_PODS_ARGS $KUBELET_NETWORK_ARGS $KUBELET_DNS_ARGS $KUBELET_AUTHZ_ARGS $KUBELET_CADVISOR_ARGS $KUBELET_CERTIFICATE_ARGS $KUBELET_EXTRA_ARGS ; ignore_errors=no ; start_time=[Wed 2018-08-29 16:09:38 UTC] ; stop_time=[Wed 2018-08-29 16:17:45 UTC] ; pid=13083 ; code=killed ; status=15/TERM }
Slice=system.slice
MemoryCurrent=18446744073709551615
CPUUsageNSec=18446744073709551615
TasksCurrent=18446744073709551615
Delegate=no
CPUAccounting=no
CPUShares=18446744073709551615
StartupCPUShares=18446744073709551615
CPUQuotaPerSecUSec=infinity
BlockIOAccounting=no
BlockIOWeight=18446744073709551615
StartupBlockIOWeight=18446744073709551615
MemoryAccounting=no
MemoryLimit=18446744073709551615
DevicePolicy=auto
TasksAccounting=no
TasksMax=18446744073709551615
Environment=KUBELET_KUBECONFIG_ARGS=--bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf\x20--kubeconfig=/etc/kubernetes/kubelet.conf KUBELET_SYSTEM_PODS_ARGS=--pod-manifest-path=/etc/kubernetes/manifests\x20--allow-privileged=true KUBELET_NETWORK_ARGS=--network-plugin=cni\x20--cni-conf-dir=/etc/cni/net.d\x20--cni-bin-dir=/opt/cni/bin KUBELET_DNS_ARGS=--cluster-dns=10.96.0.10\x20--cluster-domain=cluster.local KUBELET_AUTHZ_ARGS=--authorization-mode=Webhook\x20--client-ca-file=/etc/kubernetes/pki/ca.crt KUBELET_EXTRA_ARGS=--container-runtime=remote\x20--container-runtime-endpoint=unix:///var/run/crio/crio.sock\x20--runtime-request-timeout=30m KUBELET_CADVISOR_ARGS=--cadvisor-port=0 KUBELET_CERTIFICATE_ARGS=--rotate-certificates=true\x20--cert-dir=/var/lib/kubelet/pki
UMask=0022
LimitCPU=18446744073709551615
LimitCPUSoft=18446744073709551615
LimitFSIZE=18446744073709551615
LimitFSIZESoft=18446744073709551615
LimitDATA=18446744073709551615
LimitDATASoft=18446744073709551615
LimitSTACK=18446744073709551615
LimitSTACKSoft=8388608
LimitCORE=18446744073709551615
LimitCORESoft=0
LimitRSS=18446744073709551615
LimitRSSSoft=18446744073709551615
LimitNOFILE=4096
LimitNOFILESoft=1024
LimitAS=18446744073709551615
LimitASSoft=18446744073709551615
LimitNPROC=64083
LimitNPROCSoft=64083
LimitMEMLOCK=65536
LimitMEMLOCKSoft=65536
LimitLOCKS=18446744073709551615
LimitLOCKSSoft=18446744073709551615
LimitSIGPENDING=64083
LimitSIGPENDINGSoft=64083
LimitMSGQUEUE=819200
LimitMSGQUEUESoft=819200
LimitNICE=0
LimitNICESoft=0
LimitRTPRIO=0
LimitRTPRIOSoft=0
LimitRTTIME=18446744073709551615
LimitRTTIMESoft=18446744073709551615
OOMScoreAdjust=0
Nice=0
IOScheduling=0
CPUSchedulingPolicy=0
CPUSchedulingPriority=0
TimerSlackNSec=50000
CPUSchedulingResetOnFork=no
NonBlocking=no
StandardInput=null
StandardOutput=journal
StandardError=inherit
TTYReset=no
TTYVHangup=no
TTYVTDisallocate=no
SyslogPriority=30
SyslogLevelPrefix=yes
SyslogLevel=6
SyslogFacility=3
SecureBits=0
CapabilityBoundingSet=18446744073709551615
AmbientCapabilities=0
MountFlags=0
PrivateTmp=no
PrivateNetwork=no
PrivateDevices=no
ProtectHome=no
ProtectSystem=no
SameProcessGroup=no
UtmpMode=init
IgnoreSIGPIPE=yes
NoNewPrivileges=no
SystemCallErrorNumber=0
RuntimeDirectoryMode=0755
KillMode=control-group
KillSignal=15
SendSIGKILL=yes
SendSIGHUP=no
Id=kubelet.service
Names=kubelet.service
Requires=sysinit.target system.slice
WantedBy=multi-user.target
Conflicts=shutdown.target
Before=shutdown.target multi-user.target
After=basic.target systemd-journald.socket sysinit.target system.slice
Documentation=http://kubernetes.io/docs/
Description=kubelet: The Kubernetes Node Agent
LoadState=loaded
ActiveState=inactive
SubState=dead
FragmentPath=/lib/systemd/system/kubelet.service
DropInPaths=/etc/systemd/system/kubelet.service.d/10-kubeadm.conf
UnitFileState=enabled
UnitFilePreset=enabled
StateChangeTimestamp=Wed 2018-08-29 16:17:45 UTC
StateChangeTimestampMonotonic=1017325604812
InactiveExitTimestamp=Wed 2018-08-29 16:09:38 UTC
InactiveExitTimestampMonotonic=1016839126881
ActiveEnterTimestamp=Wed 2018-08-29 16:09:38 UTC
ActiveEnterTimestampMonotonic=1016839126881
ActiveExitTimestamp=Wed 2018-08-29 16:17:45 UTC
ActiveExitTimestampMonotonic=1017325578631
InactiveEnterTimestamp=Wed 2018-08-29 16:17:45 UTC
InactiveEnterTimestampMonotonic=1017325604812
CanStart=yes
CanStop=yes
CanReload=no
CanIsolate=no
StopWhenUnneeded=no
RefuseManualStart=no
RefuseManualStop=no
AllowIsolate=no
DefaultDependencies=yes
OnFailureJobMode=replace
IgnoreOnIsolate=no
NeedDaemonReload=no
JobTimeoutUSec=infinity
JobTimeoutAction=none
ConditionResult=yes
AssertResult=yes
ConditionTimestamp=Wed 2018-08-29 16:09:38 UTC
ConditionTimestampMonotonic=1016839125167
AssertTimestamp=Wed 2018-08-29 16:09:38 UTC
AssertTimestampMonotonic=1016839125167
Transient=no
StartLimitInterval=0
StartLimitBurst=5
StartLimitAction=none

Have crio
Output of "crio --version":

crio version 1.10.7-dev
commit: "6273bea4c9ed788aeb3d051ebf2d030060c05b6c"

Output of "systemctl show crio":

Type=simple
Restart=on-failure
NotifyAccess=none
RestartUSec=5s
TimeoutStartUSec=1min 30s
TimeoutStopUSec=1min 30s
RuntimeMaxUSec=infinity
WatchdogUSec=0
WatchdogTimestampMonotonic=0
FailureAction=none
PermissionsStartOnly=no
RootDirectoryStartOnly=no
RemainAfterExit=no
GuessMainPID=yes
MainPID=0
ControlPID=0
FileDescriptorStoreMax=0
NFileDescriptorStore=0
StatusErrno=0
Result=success
ExecMainStartTimestampMonotonic=0
ExecMainExitTimestampMonotonic=0
ExecMainPID=0
ExecMainCode=0
ExecMainStatus=0
ExecStart={ path=/usr/local/bin/crio ; argv[]=/usr/local/bin/crio --log-level debug ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }
Slice=system.slice
MemoryCurrent=18446744073709551615
CPUUsageNSec=18446744073709551615
TasksCurrent=18446744073709551615
Delegate=no
CPUAccounting=no
CPUShares=18446744073709551615
StartupCPUShares=18446744073709551615
CPUQuotaPerSecUSec=infinity
BlockIOAccounting=no
BlockIOWeight=18446744073709551615
StartupBlockIOWeight=18446744073709551615
MemoryAccounting=no
MemoryLimit=18446744073709551615
DevicePolicy=auto
TasksAccounting=no
TasksMax=18446744073709551615
UMask=0022
LimitCPU=18446744073709551615
LimitCPUSoft=18446744073709551615
LimitFSIZE=18446744073709551615
LimitFSIZESoft=18446744073709551615
LimitDATA=18446744073709551615
LimitDATASoft=18446744073709551615
LimitSTACK=18446744073709551615
LimitSTACKSoft=8388608
LimitCORE=18446744073709551615
LimitCORESoft=0
LimitRSS=18446744073709551615
LimitRSSSoft=18446744073709551615
LimitNOFILE=4096
LimitNOFILESoft=1024
LimitAS=18446744073709551615
LimitASSoft=18446744073709551615
LimitNPROC=64083
LimitNPROCSoft=64083
LimitMEMLOCK=65536
LimitMEMLOCKSoft=65536
LimitLOCKS=18446744073709551615
LimitLOCKSSoft=18446744073709551615
LimitSIGPENDING=64083
LimitSIGPENDINGSoft=64083
LimitMSGQUEUE=819200
LimitMSGQUEUESoft=819200
LimitNICE=0
LimitNICESoft=0
LimitRTPRIO=0
LimitRTPRIOSoft=0
LimitRTTIME=18446744073709551615
LimitRTTIMESoft=18446744073709551615
OOMScoreAdjust=0
Nice=0
IOScheduling=0
CPUSchedulingPolicy=0
CPUSchedulingPriority=0
TimerSlackNSec=50000
CPUSchedulingResetOnFork=no
NonBlocking=no
StandardInput=null
StandardOutput=journal
StandardError=inherit
TTYReset=no
TTYVHangup=no
TTYVTDisallocate=no
SyslogPriority=30
SyslogLevelPrefix=yes
SyslogLevel=6
SyslogFacility=3
SecureBits=0
CapabilityBoundingSet=18446744073709551615
AmbientCapabilities=0
MountFlags=0
PrivateTmp=no
PrivateNetwork=no
PrivateDevices=no
ProtectHome=no
ProtectSystem=no
SameProcessGroup=no
UtmpMode=init
IgnoreSIGPIPE=yes
NoNewPrivileges=no
SystemCallErrorNumber=0
RuntimeDirectoryMode=0755
KillMode=control-group
KillSignal=15
SendSIGKILL=yes
SendSIGHUP=no
Id=crio.service
Names=crio.service
Requires=sysinit.target system.slice
Conflicts=shutdown.target
Before=shutdown.target
After=basic.target systemd-journald.socket sysinit.target system.slice
Documentation=https://github.com/kubernetes-incubator/cri-o
Description=CRI-O daemon
LoadState=loaded
ActiveState=inactive
SubState=dead
FragmentPath=/etc/systemd/system/crio.service
UnitFileState=disabled
UnitFilePreset=enabled
StateChangeTimestampMonotonic=0
InactiveExitTimestampMonotonic=0
ActiveEnterTimestampMonotonic=0
ActiveExitTimestampMonotonic=0
InactiveEnterTimestampMonotonic=0
CanStart=yes
CanStop=yes
CanReload=no
CanIsolate=no
StopWhenUnneeded=no
RefuseManualStart=no
RefuseManualStop=no
AllowIsolate=no
DefaultDependencies=yes
OnFailureJobMode=replace
IgnoreOnIsolate=no
NeedDaemonReload=no
JobTimeoutUSec=infinity
JobTimeoutAction=none
ConditionResult=no
AssertResult=no
ConditionTimestampMonotonic=0
AssertTimestampMonotonic=0
Transient=no
StartLimitInterval=10000000
StartLimitBurst=5
StartLimitAction=none

Packages

ii  kata-containers-image               1.2.0-32                                   amd64        Kata containers image
ii  qemu-lite                           2.11.0+git.a39e0b3e82-47                   amd64        linux kernel optimised for container-like workloads.

jodh-intel · 2018-08-29T17:01:12Z

Hi @GabyCT - the output above is showing that you are using an osbuilder image based on Clr with agent version fcfa054a757e7c17afba47b0b4d7e91cbb8688ed - but that is not the latest version. You need to build a custom image with the latest version of the agent inside it:

https://github.com/kata-containers/documentation/blob/master/Developer-Guide.md#create-a-rootfs-image

GabyCT · 2018-10-22T16:45:13Z

Closing this issue as is not longer present with the following configuration

  [Runtime.Version]
    Semver = "1.3.0"
    Commit = "40ee885e8e0f52d753a392abb12319692a41eb79"
    OCI = "1.0.1"
 
kata-proxy version 1.3.0-6ddb006ad3f709cab018af9dc0bf9e756c3ce2cd
kata-shim version 1.3.0-5fbf1f0919ce0bb1f2b7e85692cdf3058023926f

not all the hypervisors connect a socket to /dev/console, so it's no possible to get the agent's logs from a unix socket. This patch is to connect the logger (logrus) to a vsock port, this way the logs can be read in the host using vsocks or hybrid vsocks. fixes kata-containers#652 Signed-off-by: Julio Montes <[email protected]>

GabyCT closed this as completed Oct 22, 2018

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Pod information is left while assigning host networking with docker #652

Pod information is left while assigning host networking with docker #652

GabyCT commented Aug 27, 2018

jodh-intel commented Aug 28, 2018

jodh-intel commented Aug 28, 2018

amshinde commented Aug 28, 2018

GabyCT commented Aug 28, 2018

jodh-intel commented Aug 29, 2018

GabyCT commented Aug 29, 2018

GabyCT commented Aug 29, 2018

jodh-intel commented Aug 29, 2018

GabyCT commented Aug 29, 2018

grahamwhaley commented Aug 29, 2018

GabyCT commented Aug 29, 2018

GabyCT commented Aug 29, 2018

jodh-intel commented Aug 29, 2018

GabyCT commented Oct 22, 2018

Pod information is left while assigning host networking with docker #652

Pod information is left while assigning host networking with docker #652

Comments

GabyCT commented Aug 27, 2018

jodh-intel commented Aug 28, 2018

jodh-intel commented Aug 28, 2018

amshinde commented Aug 28, 2018

GabyCT commented Aug 28, 2018

jodh-intel commented Aug 29, 2018

GabyCT commented Aug 29, 2018

GabyCT commented Aug 29, 2018

jodh-intel commented Aug 29, 2018

GabyCT commented Aug 29, 2018

grahamwhaley commented Aug 29, 2018

GabyCT commented Aug 29, 2018

GabyCT commented Aug 29, 2018

Runtime config files

Runtime default config files

Runtime config file contents

Image details

Initrd details

Logfiles

Runtime logs

Proxy logs

Shim logs

Container manager details

Docker

Kubernetes

Packages

jodh-intel commented Aug 29, 2018

GabyCT commented Oct 22, 2018