Device goes offline on app, when I reboot my debian device

I have installed remoteit on a debian based device ( owasys platform). It works fine and I can connect to it remotely with SSH but when I reboot the platform the device goes offline on the remoteit app/website and I cannot access it anymore. What can I do to fix this, please?

Hi,

Have you checked if it is your device is connected to internet after reboot?

Hi,
Yes it is connected

Hi @El3oss,

After reboot if it is not connecting are manually starting it again?

Also is it possible to share logs after boot, maybe journactl -e will work.

Can you explain what and how you installed?
What type of internet connection does this device have?
Are there any outbound firewall rules at the location?
Can you check your running processes to check if remoteit or connectd is running?

1 Like

When I run journalctl -e it I get

Aug 01 10:13:39 A10F63 systemd[1]: remoteit@null.service: Succeeded.
Aug 01 10:13:39 A10F63 systemd[1]: Stopped Remote tcp connection service null.
Aug 01 10:13:39 A10F63 systemd[1]: /usr/lib/systemd/system/remoteit@.service:7: PIDFile= references path below legacy directory /var/run/, updating /var/run/remoteit-null.pid → /run/remoteit-null.pid;
Aug 01 10:13:39 A10F63 systemd[1]: /usr/lib/systemd/system/remoteit@.service:7: PIDFile= references path below legacy directory /var/run/, updating /var/run/remoteit-null.pid → /run/remoteit-null.pid;
Aug 01 10:13:39 A10F63 systemd[1]: /usr/lib/systemd/system/remoteit@.service:7: PIDFile= references path below legacy directory /var/run/, updating /var/run/remoteit-null.pid → /run/remoteit-null.pid;
Aug 01 10:13:39 A10F63 systemd[1]: remoteit-refresh.service: Main process exited, code=exited, status=1/FAILURE
Aug 01 10:13:39 A10F63 systemd[1]: remoteit-refresh.service: Failed with result 'exit-code'.
Aug 01 10:13:39 A10F63 systemd[1]: remoteit-refresh.service: Service RestartSec=100ms expired, scheduling restart.
Aug 01 10:13:39 A10F63 systemd[1]: remoteit-refresh.service: Scheduled restart job, restart counter is at 154.
Aug 01 10:13:39 A10F63 systemd[1]: Stopped Remoteit configuration refresh service.
Aug 01 10:13:39 A10F63 systemd[1]: Started Remoteit configuration refresh service.
Aug 01 10:13:43 A10F63 remoteit[21823]: Updating remote.it configuration.
Aug 01 10:13:43 A10F63 refresh.sh[21813]: curl: (60) SSL certificate problem: unable to get local issuer certificate
Aug 01 10:13:43 A10F63 refresh.sh[21813]: More details here: https://curl.haxx.se/docs/sslcerts.html
Aug 01 10:13:43 A10F63 refresh.sh[21813]: curl failed to verify the legitimacy of the server and therefore could not
Aug 01 10:13:43 A10F63 refresh.sh[21813]: establish a secure connection to it. To learn more about this situation and
Aug 01 10:13:43 A10F63 refresh.sh[21813]: how to fix it, please visit the web page mentioned above.
Aug 01 10:13:43 A10F63 remoteit[21846]: Fail to update remote.it configuration with curl command failure.
Aug 01 10:13:43 A10F63 refresh.sh[21813]: Start Services
Aug 01 10:13:44 A10F63 systemd[1]: Reloading.
Aug 01 10:13:45 A10F63 systemd[1]: /usr/lib/systemd/system/schannel.service:7: PIDFile= references path below legacy directory /var/run/, updating /var/run/schannel.pid → /run/schannel.pid; please upda
Aug 01 10:13:46 A10F63 systemd[1]: Reloading Remote tcp command service.
Aug 01 10:13:46 A10F63 systemd[1]: Reloaded Remote tcp command service.
Aug 01 10:13:47 A10F63 systemd[1]: Reloading.
Aug 01 10:13:48 A10F63 systemd[1]: /usr/lib/systemd/system/schannel.service:7: PIDFile= references path below legacy directory /var/run/, updating /var/run/schannel.pid → /run/schannel.pid; please upda
Aug 01 10:13:48 A10F63 systemd[1]: /usr/lib/systemd/system/remoteit@.service:7: PIDFile= references path below legacy directory /var/run/, updating /var/run/remoteit-null.pid → /run/remoteit-null.pid;
Aug 01 10:13:50 A10F63 systemd[1]: Starting Remote tcp connection service null...
Aug 01 10:13:56 A10F63 remoteit.sh[21902]: Removed /etc/systemd/system/multi-user.target.wants/remoteit@null.service.
Aug 01 10:13:56 A10F63 systemd[1]: Reloading.
Aug 01 10:13:58 A10F63 systemd[1]: /usr/lib/systemd/system/schannel.service:7: PIDFile= references path below legacy directory /var/run/, updating /var/run/schannel.pid → /run/schannel.pid; please upda
Aug 01 10:13:59 A10F63 systemd[1]: /usr/lib/systemd/system/remoteit@.service:7: PIDFile= references path below legacy directory /var/run/, updating /var/run/remoteit-null.pid → /run/remoteit-null.pid;
Aug 01 10:14:00 A10F63 systemd[1]: remoteit@null.service: Control process exited, code=killed, status=15/TERM
Aug 01 10:14:00 A10F63 systemd[1]: remoteit@null.service: Succeeded.
Aug 01 10:14:00 A10F63 systemd[1]: Stopped Remote tcp connection service null.
Aug 01 10:14:00 A10F63 systemd[1]: /usr/lib/systemd/system/remoteit@.service:7: PIDFile= references path below legacy directory /var/run/, updating /var/run/remoteit-null.pid → /run/remoteit-null.pid;
Aug 01 10:14:00 A10F63 systemd[1]: /usr/lib/systemd/system/remoteit@.service:7: PIDFile= references path below legacy directory /var/run/, updating /var/run/remoteit-null.pid → /run/remoteit-null.pid;
Aug 01 10:14:00 A10F63 systemd[1]: /usr/lib/systemd/system/remoteit@.service:7: PIDFile= references path below legacy directory /var/run/, updating /var/run/remoteit-null.pid → /run/remoteit-null.pid;
Aug 01 10:14:00 A10F63 systemd[1]: remoteit-refresh.service: Main process exited, code=exited, status=1/FAILURE
Aug 01 10:14:00 A10F63 systemd[1]: remoteit-refresh.service: Failed with result 'exit-code'.
Aug 01 10:14:00 A10F63 systemd[1]: remoteit-refresh.service: Service RestartSec=100ms expired, scheduling restart.
Aug 01 10:14:00 A10F63 systemd[1]: remoteit-refresh.service: Scheduled restart job, restart counter is at 155.
Aug 01 10:14:00 A10F63 systemd[1]: Stopped Remoteit configuration refresh service.
Aug 01 10:14:00 A10F63 systemd[1]: Started Remoteit configuration refresh service.
Aug 01 10:14:04 A10F63 remoteit[21957]: Updating remote.it configuration.
Aug 01 10:14:04 A10F63 refresh.sh[21947]: curl: (60) SSL certificate problem: unable to get local issuer certificate
Aug 01 10:14:04 A10F63 refresh.sh[21947]: More details here: https://curl.haxx.se/docs/sslcerts.html
Aug 01 10:14:04 A10F63 refresh.sh[21947]: curl failed to verify the legitimacy of the server and therefore could not
Aug 01 10:14:04 A10F63 refresh.sh[21947]: establish a secure connection to it. To learn more about this situation and
Aug 01 10:14:04 A10F63 refresh.sh[21947]: how to fix it, please visit the web page mentioned above.
Aug 01 10:14:04 A10F63 remoteit[21980]: Fail to update remote.it configuration with curl command failure.
Aug 01 10:14:04 A10F63 refresh.sh[21947]: Start Services
Aug 01 10:14:04 A10F63 systemd[1]: Reloading.
Aug 01 10:14:06 A10F63 systemd[1]: /usr/lib/systemd/system/schannel.service:7: PIDFile= references path below legacy directory /var/run/, updating /var/run/schannel.pid → /run/schannel.pid; please upda
Aug 01 10:14:07 A10F63 systemd[1]: Reloading Remote tcp command service.
Aug 01 10:14:07 A10F63 systemd[1]: Reloaded Remote tcp command service.
Aug 01 10:14:07 A10F63 systemd[1]: Reloading.
Aug 01 10:14:09 A10F63 systemd[1]: /usr/lib/systemd/system/schannel.service:7: PIDFile= references path below legacy directory /var/run/, updating /var/run/schannel.pid → /run/schannel.pid; please upda
Aug 01 10:14:09 A10F63 systemd[1]: /usr/lib/systemd/system/remoteit@.service:7: PIDFile= references path below legacy directory /var/run/, updating /var/run/remoteit-null.pid → /run/remoteit-null.pid;

Hi, I am running on a platform that uses Linux Debian armv7l. Remoteit was installed from my account, by clicking + then choosing debian linux. I have installed other versions though before this, I installed Linux and raspberry Pi ones but I have deleted them with

sudo apt purge remoteit

Before the restart it always works fine, when I restart or shut down and witch on again the device, it goes offline

this is connected through LAN from a broadband router then it will be deployed in a location where the is a Sim-router connection (always through LAN).

It accepts all traffic coming from either openVPN or others as seen below when running iptables -L

Chain INPUT (policy ACCEPT)
target     prot opt source               destination
ACCEPT     udp  --  anywhere             anywhere             udp dpt:openvpn
ACCEPT     all  --  anywhere             anywhere

Chain FORWARD (policy ACCEPT)
target     prot opt source               destination
ACCEPT     all  --  anywhere             anywhere
ACCEPT     all  --  anywhere             anywhere

Chain OUTPUT (policy ACCEPT)
target     prot opt source               destination

when I run ps aux | grep remoteit I find

root       280  0.4  2.7 677284 13796 ?        Ssl  09:20   0:06 /home/debian/remoteit.arm-v7-linux run --config /etc/remoteit/config.json
root       342  0.0  0.0   1408    96 ?        S    09:20   0:00 /usr/share/remoteit/schannel -f /usr/share/remoteit/schannel.conf -d /var/run/schannel.pid
root      9535  0.3  0.1   1464   900 ?        Ss   09:42   0:00 /bin/sh /usr/share/remoteit/refresh.sh boot
root      9603  3.0  0.3   6148  1880 ?        S    09:42   0:00 systemctl enable remoteit@null
debian    9624  0.0  0.0   2108   460 pts/0    S+   09:42   0:00 grep remoteit

and ps aux | grep connected

debian   10995  0.0  0.0   2108   428 pts/0    S+   09:46   0:00 grep connectd

To give you more info if I missed anything, these are all the running processes when using ps -e

  PID TTY          TIME CMD
    1 ?        00:06:36 systemd
    2 ?        00:00:00 kthreadd
    3 ?        00:00:00 rcu_gp
    4 ?        00:00:00 rcu_par_gp
    6 ?        00:00:00 kworker/0:0H-events_highpri
    7 ?        00:00:02 kworker/u2:0-events_unbound
    8 ?        00:00:00 mm_percpu_wq
    9 ?        00:00:03 ksoftirqd/0
   10 ?        00:00:08 rcu_preempt
   11 ?        00:00:00 rcu_sched
   12 ?        00:00:00 rcu_bh
   13 ?        00:00:00 migration/0
   14 ?        00:00:00 cpuhp/0
   15 ?        00:00:00 kdevtmpfs
   16 ?        00:00:00 netns
   17 ?        00:00:00 rcu_tasks_kthre
   19 ?        00:00:00 kauditd
   20 ?        00:00:00 oom_reaper
   21 ?        00:00:00 writeback
   22 ?        00:00:00 kcompactd0
   23 ?        00:00:00 crypto
   24 ?        00:00:00 kblockd
   25 ?        00:00:00 edac-poller
   26 ?        00:00:00 watchdogd
   27 ?        00:00:00 rpciod
   28 ?        00:00:00 kworker/u3:0
   29 ?        00:00:00 xprtiod
   30 ?        00:00:00 kswapd0
   31 ?        00:00:00 nfsiod
   61 ?        00:00:00 kpcitest
   62 ?        00:00:00 hwrng
   64 ?        00:00:00 spi0
   65 ?        00:00:00 spi1
   67 ?        00:00:00 53500000.aes-en
   82 ?        00:00:00 irq/60-4803c000
   83 ?        00:00:00 irq/59-4803c000
   84 ?        00:00:00 ipv6_addrconf
   85 ?        00:00:00 irq/36-4802a000
   88 ?        00:00:00 ubi_bgt0d
   89 ?        00:00:00 ubifs_bgt0_0
  129 ?        00:00:00 cfg80211
  135 ?        00:00:00 MOAL_HANG_WORK_
  138 ?        00:00:01 systemd-udevd
  146 ?        00:00:00 systemd-network
  249 ?        00:00:08 systemd-journal
  251 ?        00:00:00 systemd-resolve
  266 ?        00:00:00 dhclient
  269 ?        00:00:00 alsactl
  270 ?        00:00:28 pmsrv
  273 ?        00:01:11 dbus-daemon
  278 ?        00:00:00 cron
  280 ?        00:00:07 remoteit.arm-v7
  282 ?        00:00:01 rsyslogd
  283 ?        00:00:30 systemd-logind
  284 ?        00:00:00 ptp0
  313 ?        00:00:00 dhcpcd
  342 ?        00:00:00 schannel
  343 ?        00:00:00 openvpn
  366 ?        00:00:12 redis-server
  368 tty1     00:00:00 agetty
  369 ttyO4    00:00:00 agetty
  446 ?        00:00:05 pollux-net
  449 ?        00:00:21 pollux-gps
  553 ?        00:00:01 pollux-time
  564 ?        00:00:00 systemd-timesyn
  773 ?        00:00:00 kworker/0:1H-events_highpri
  832 ?        00:00:00 sshd
  842 ?        00:00:00 sshd
  888 ?        00:00:01 systemd
  907 ?        00:00:00 (sd-pam)
  958 ?        00:00:00 sshd
  961 ?        00:00:00 sshd
  982 pts/0    00:00:00 bash
  984 ?        00:00:00 sftp-server
 1050 ?        00:00:01 kworker/0:4-pm
 4137 ?        00:00:01 kworker/0:1-rcu_gp
 6904 ?        00:00:01 kworker/0:3-pm
 8598 ?        00:00:01 kworker/u2:2-events_unbound
 9005 ?        00:00:00 kworker/0:2-events_power_efficient
 9070 ?        00:00:00 kworker/u2:3-events_unbound
11061 ?        00:00:00 kworker/u2:1-events_unbound
11730 ?        00:00:00 kworker/0:0-events_freezable
12492 ?        00:00:00 refresh.sh
12495 ?        00:00:00 refresh.sh
12498 ?        00:00:00 refresh.sh
12499 ?        00:00:00 curl
12500 pts/0    00:00:00 ps

Looks like you local certificates are not updated, whenever device is restarting remote.it referesh service checks if there any updates available and in your case it is exiting with error and i guess that might be the problem.

try sudo apt-get install ca-certificates
and also sudo apt update && sudo apt upgrade

if the issue is still not resolved, check this topic curl: (60) SSL certificate problem: unable to get local issuer certificate - Stack Overflow

thanks

I have fixed the certificate issue by updating the list of certificates

sudo update-ca-certificates -f

Necertheless the device is still offline, when I run journalctl -e again, I can find:


Aug 01 13:58:05 A10F63 systemd[1]: /usr/lib/systemd/system/remoteit@.service:7: PIDFile= references path below legacy directory /var/run/, updating /var/run/remoteit-null.pid → /run/remoteit-null.pid;
Aug 01 13:58:05 A10F63 systemd[1]: /usr/lib/systemd/system/remoteit@.service:7: PIDFile= references path below legacy directory /var/run/, updating /var/run/remoteit-null.pid → /run/remoteit-null.pid;
Aug 01 13:58:05 A10F63 systemd[1]: remoteit-refresh.service: Main process exited, code=exited, status=1/FAILURE
Aug 01 13:58:05 A10F63 systemd[1]: remoteit-refresh.service: Failed with result 'exit-code'.
Aug 01 13:58:06 A10F63 systemd[1]: remoteit-refresh.service: Service RestartSec=100ms expired, scheduling restart.
Aug 01 13:58:06 A10F63 systemd[1]: remoteit-refresh.service: Scheduled restart job, restart counter is at 489.
Aug 01 13:58:06 A10F63 systemd[1]: Stopped Remoteit configuration refresh service.
Aug 01 13:58:06 A10F63 systemd[1]: Started Remoteit configuration refresh service.
Aug 01 13:58:09 A10F63 remoteit[5097]: Updating remote.it configuration.
Aug 01 13:58:13 A10F63 refresh.sh[5087]: Start Services
Aug 01 13:58:13 A10F63 systemd[1]: Reloading.
Aug 01 13:58:15 A10F63 systemd[1]: /usr/lib/systemd/system/schannel.service:7: PIDFile= references path below legacy directory /var/run/, updating /var/run/schannel.pid → /run/schannel.pid; please upda
Aug 01 13:58:16 A10F63 systemd[1]: Reloading Remote tcp command service.
Aug 01 13:58:16 A10F63 systemd[1]: Reloaded Remote tcp command service.
Aug 01 13:58:16 A10F63 systemd[1]: Reloading.
Aug 01 13:58:18 A10F63 systemd[1]: /usr/lib/systemd/system/schannel.service:7: PIDFile= references path below legacy directory /var/run/, updating /var/run/schannel.pid → /run/schannel.pid; please upda
Aug 01 13:58:18 A10F63 systemd[1]: /usr/lib/systemd/system/remoteit@.service:7: PIDFile= references path below legacy directory /var/run/, updating /var/run/remoteit-a38091a.pid → /run/remoteit-a38091a
Aug 01 13:58:20 A10F63 systemd[1]: Starting Remote tcp connection service a38091a...
Aug 01 13:58:26 A10F63 Connectd[5175]: Connectd Target built Jul 12 2023 at 03:10:55
Aug 01 13:58:26 A10F63 Connectd[5175]:    Version 4.18.3.1689131372 - (c)2019 remot3.it, Inc. All Rights Reserved
Aug 01 13:58:26 A10F63 systemd[1]: remoteit@a38091a.service: Can't open PID file /run/remoteit-a38091a.pid (yet?) after start: No such file or directory
Aug 01 13:58:26 A10F63 Connectd[5175]: Starting up as daemon
Aug 01 13:58:27 A10F63 remoteit.sh[5175]: Connectd built Jul 12 2023 at 03:10:55 Now Starting Up
Aug 01 13:58:27 A10F63 remoteit.sh[5175]:    Version 4.18.3.1689131372 - (c)2023 remot3.it, Inc. All Rights Reserved
Aug 01 13:58:27 A10F63 remoteit.sh[5175]:    Built with arm-linux-gnueabihf-gcc tools ALIGN BCASTER LINUX RESOLVE BIGBUF BACKTRACE NATIVE_MALLOC
Aug 01 13:58:27 A10F63 remoteit.sh[5175]:    Raspberry Pi Version
Aug 01 13:58:27 A10F63 remoteit.sh[5175]: Starting up as daemon
Aug 01 13:58:27 A10F63 remoteit.sh[5175]: PID file specified as /var/run/remoteit-a38091a.pid
Aug 01 13:58:27 A10F63 remoteit.sh[5175]: setting web config port to dest_server_port 80
Aug 01 13:58:27 A10F63 remoteit.sh[5175]: init fe state 3
Aug 01 13:58:27 A10F63 remoteit.sh[5175]: primary local ip = 155.245.23.56
Aug 01 13:58:27 A10F63 systemd[1]: Started Remote tcp connection service a38091a.
Aug 01 13:58:26 A10F63 Connectd[5175]: Parent Exited Normally.
Aug 01 13:58:26 A10F63 Connectd[5194]: Begin Startup.
Aug 01 13:58:27 A10F63 Connectd[5195]: Creating pidfile /var/run/remoteit-a38091a.pid with PID 5195
Aug 01 13:58:27 A10F63 Connectd[5195]:   Using device uid = 90:00:00:00:00:05:80:92
Aug 01 13:58:27 A10F63 Connectd[5195]: initialize TCP target 127.0.0.1 port 65535
Aug 01 13:58:27 A10F63 Connectd[5195]: 39710> Remot3it Registration Code Provided (checkhash 9b:7d)
Aug 01 13:58:27 A10F63 systemd[1]: remoteit-refresh.service: Succeeded.
Aug 01 13:58:27 A10F63 Connectd[5195]: 39712> sending req auth to 54.218.6.237:5959
Aug 01 13:58:27 A10F63 Connectd[5195]: 39713> Status redirect to  44.239.243.92:5960
Aug 01 13:58:27 A10F63 Connectd[5195]: 39713> sending req auth to 44.239.243.92:5960
Aug 01 13:58:27 A10F63 Connectd[5195]: 39715> NAT type selected at 3 with natmap 2
Aug 01 13:58:27 A10F63 Connectd[5195]: Server Connection changed to state 4
Aug 01 13:58:27 A10F63 Connectd[5195]: Server Connection changed to state 5
Aug 01 13:58:27 A10F63 Connectd[5195]: Connected to server is 44.239.243.92:5960
Aug 01 14:00:45 A10F63 systemd[1]: Started OpenBSD Secure Shell server per-connection daemon (155.245.23.53:60564).
Aug 01 14:00:45 A10F63 sshd[5204]: Accepted password for debian from 155.245.23.53 port 60564 ssh2
Aug 01 14:00:45 A10F63 sshd[5204]: pam_unix(sshd:session): session opened for user debian by (uid=0)
Aug 01 14:00:45 A10F63 systemd-logind[268]: New session 29 of user debian.
Aug 01 14:00:45 A10F63 systemd[1]: Started Session 29 of user debian.
Aug 01 14:00:45 A10F63 systemd[1]: Started OpenBSD Secure Shell server per-connection daemon (155.245.23.53:60565).
Aug 01 14:00:45 A10F63 sshd[5204]: pam_env(sshd:session): Unable to open env file: /etc/default/locale: No such file or directory
Aug 01 14:00:46 A10F63 sshd[5206]: Accepted password for debian from 155.245.23.53 port 60565 ssh2
Aug 01 14:00:46 A10F63 sshd[5206]: pam_unix(sshd:session): session opened for user debian by (uid=0)
Aug 01 14:00:46 A10F63 systemd-logind[268]: New session 30 of user debian.
Aug 01 14:00:46 A10F63 systemd[1]: Started Session 30 of user debian.
Aug 01 14:00:46 A10F63 sshd[5206]: pam_env(sshd:session): Unable to open env file: /etc/default/locale: No such file or directory
lines 944-1001/1001 (END)

Hi @El3oss,

I referred https://support.remote.it/hc/en-us/articles/360051668711-Updating-the-remoteit-or-connectd-packages-using-a-remote-it-SSH-connection and I read

Danger

DO NOT install remoteit over the connectd package. Doing so will result in loss of connectivity if you reboot. To check whether the connectd package is installed, run:

sudo dpkg -s connectd

Did you install remote.it multiple times?

Try removing remote.it and install again?

I have followed the steps to remove it, I have installed it using the + to add a device then selected Linux, it was successfully installed and I was able to connect, but it went offline after restart and did not start again.

So Before restarting running:

ps aux | grep remoteit I got:

root       255  0.3  2.6 677540 13508 ?        Ssl  15:46   0:05 /home/debian/remoteit.arm-v7-linux run --config /etc/remoteit/config.json
root      1814  0.1  0.2   1932  1220 ?        S    16:03   0:01 /usr/share/remoteit/connectd -d /var/run/remoteit-012002e.pid -e bWF4X2RlcHRoIDM1CmFwcGxpY2F0aW9uX3R5cGUgMjgKcHJveHlfZGVzdF9pcCAxMjcuMC4wLjEKbWFudWZhY3R1cmVfaWQgMApwbGF0Zm9ybV92ZXJzaW9uIDc2OQpwcm94eV9kZXN0X3BvcnQgMjIKVUlEIDkwOjAwOjAwOjAwOjAwOjA1OjgyOkY1CnNlY3JldCAxOUJDQ0ZFMEJBNTJDQjVGOEExNUQwMTlGNzdBMDJGNjgyOTg2NTFCCiMK
root      1860  0.1  0.2   1932  1220 ?        S    16:03   0:00 /usr/share/remoteit/connectd -d /var/run/remoteit-2b04782.pid -e bWF4X2RlcHRoIDM1CmFwcGxpY2F0aW9uX3R5cGUgMzUKcHJveHlfZGVzdF9pcCAxMjcuMC4wLjEKbWFudWZhY3R1cmVfaWQgMApwbGF0Zm9ybV92ZXJzaW9uIDc2OQpwcm94eV9kZXN0X3BvcnQgNjU1MzUKYXBwbGljYXRpb25fdHlwZV9vdmVybG9hZCA0MApVSUQgOTA6MDA6MDA6MDA6MDA6MDU6ODI6RjQKc2VjcmV0IDFDODU2NjdCNjk4MERDN0VGRDNEOEFCODY1NjFERTM5NTkwOUVGQjQKIwo=
debian    2020  0.0  0.0   2108   468 pts/0    S+   16:12   0:00 grep remoteit

Now running journalctl -e


Aug 01 16:15:03 A10F63 systemd[1]: Stopped Remote tcp command service.
Aug 01 16:15:03 A10F63 systemd[1]: Starting Remote tcp command service...
Aug 01 16:15:03 A10F63 schannel[2047]: server_channel_handler built May  4 2021 at 00:37:35
Aug 01 16:15:03 A10F63 schannel[2047]:    Version 0.7.0.1620088644  -  (c)2019 remot3.it, Inc. All Rights Reserved
Aug 01 16:15:03 A10F63 schannel[2047]: bind
Aug 01 16:15:03 A10F63 schannel[2047]: : Address already in use
Aug 01 16:15:03 A10F63 schannel[2047]: Starting up as daemon
Aug 01 16:15:03 A10F63 systemd[1]: schannel.service: Control process exited, code=exited, status=1/FAILURE
Aug 01 16:15:03 A10F63 systemd[1]: schannel.service: Failed with result 'exit-code'.
Aug 01 16:15:03 A10F63 systemd[1]: Failed to start Remote tcp command service.

running sudo systemctl list-unit-files --state=enabled gives:


  PID TTY          TIME CMD
    1 ?        00:00:25 systemd
    2 ?        00:00:00 kthreadd
    3 ?        00:00:00 rcu_gp
    4 ?        00:00:00 rcu_par_gp
    6 ?        00:00:00 kworker/0:0H
    8 ?        00:00:00 mm_percpu_wq
    9 ?        00:00:00 ksoftirqd/0
   10 ?        00:00:00 rcu_preempt
   11 ?        00:00:00 rcu_sched
   12 ?        00:00:00 rcu_bh
   13 ?        00:00:00 migration/0
   14 ?        00:00:00 cpuhp/0
   15 ?        00:00:00 kdevtmpfs
   16 ?        00:00:00 netns
   17 ?        00:00:00 rcu_tasks_kthre
   18 ?        00:00:02 kworker/0:1-events_power_efficient
   19 ?        00:00:00 kauditd
   20 ?        00:00:00 oom_reaper
   21 ?        00:00:00 writeback
   22 ?        00:00:00 kcompactd0
   23 ?        00:00:00 crypto
   24 ?        00:00:00 kblockd
   25 ?        00:00:00 edac-poller
   26 ?        00:00:00 watchdogd
   27 ?        00:00:00 rpciod
   28 ?        00:00:00 kworker/u3:0
   29 ?        00:00:00 xprtiod
   30 ?        00:00:00 kswapd0
   31 ?        00:00:00 nfsiod
   61 ?        00:00:00 kpcitest
   62 ?        00:00:00 hwrng
   63 ?        00:00:00 kworker/u2:1-events_unbound
   64 ?        00:00:00 spi0
   65 ?        00:00:00 spi1
   67 ?        00:00:00 53500000.aes-en
   82 ?        00:00:00 irq/60-4803c000
   83 ?        00:00:00 irq/59-4803c000
   84 ?        00:00:00 ipv6_addrconf
   85 ?        00:00:00 irq/36-4802a000
   88 ?        00:00:00 ubi_bgt0d
   89 ?        00:00:00 ubifs_bgt0_0
  129 ?        00:00:00 cfg80211
  134 ?        00:00:00 MOAL_HANG_WORK_
  138 ?        00:00:00 systemd-udevd
  149 ?        00:00:00 systemd-network
  243 ?        00:00:00 systemd-resolve
  255 ?        00:00:05 remoteit.arm-v7
  257 ?        00:00:26 pmsrv
  262 ?        00:00:00 rsyslogd
  266 ?        00:00:00 alsactl
  271 ?        00:00:00 cron
  275 ?        00:00:03 dbus-daemon
  276 ?        00:00:01 systemd-logind
  279 ?        00:00:00 dhclient
  302 ?        00:00:00 dhcpcd
  310 ?        00:00:00 ptp0
  361 ?        00:00:00 redis-server
  368 ?        00:00:02 systemd-journal
  370 ?        00:00:00 openvpn
  440 ttyO4    00:00:00 agetty
  446 tty1     00:00:00 agetty
  565 ?        00:00:00 ntpd
  567 ?        00:00:00 sshd
  569 ?        00:00:00 sshd
  572 ?        00:00:00 systemd
  573 ?        00:00:00 (sd-pam)
  586 ?        00:00:00 sshd
  587 ?        00:00:00 sshd
  588 pts/0    00:00:00 bash
  589 ?        00:00:00 sftp-server
 1276 ?        00:00:01 kworker/0:0-events_freezable
 1286 ?        00:00:00 kworker/0:2-cgroup_destroy
 1814 ?        00:00:00 connectd
 1836 ?        00:00:00 kworker/0:3-memcg_kmem_cache
 1860 ?        00:00:00 connectd
 1861 ?        00:00:00 kworker/u2:0-events_unbound
 1926 ?        00:00:00 kworker/0:4-events_power_efficient
 1968 ?        00:00:00 kworker/0:5
 2009 pts/0    00:00:00 ps

after restart the device goes offline and I get:
running: ps aux | grep remoteit:

grep: I: No such file or directory
grep: got: No such file or directory

journalctl -e

Aug 01 16:23:21 A10F63 systemd[1]: remoteit@2b04782.service: Succeeded.
Aug 01 16:23:21 A10F63 systemd[1]: Stopped Remote tcp connection service 2b04782.
Aug 01 16:23:21 A10F63 systemd[1]: Reloaded Remote tcp command service.
Aug 01 16:23:22 A10F63 systemd[1]: Reached target Multi-User System.
Aug 01 16:23:22 A10F63 systemd[1]: Reached target Graphical Interface.
Aug 01 16:23:22 A10F63 systemd[1]: Starting Update UTMP about System Runlevel Changes...
Aug 01 16:23:22 A10F63 systemd[1]: systemd-update-utmp-runlevel.service: Succeeded.
Aug 01 16:23:22 A10F63 systemd[1]: Started Update UTMP about System Runlevel Changes.
Aug 01 16:23:22 A10F63 systemd[1]: Reloading.
Aug 01 16:23:24 A10F63 systemd[1]: /usr/lib/systemd/system/schannel.service:7: PIDFile= references path below legacy directory /var/run/, updating /var/run/schannel.pid → /run/schannel.pid; please upda
Aug 01 16:23:24 A10F63 systemd[1]: /usr/lib/systemd/system/remoteit@.service:7: PIDFile= references path below legacy directory /var/run/, updating /var/run/remoteit-d9eb5a5.pid → /run/remoteit-d9eb5a5
Aug 01 16:23:26 A10F63 systemd[1]: Starting Remote tcp connection service d9eb5a5...
Aug 01 16:23:27 A10F63 systemd[1]: logrotate.service: Succeeded.
Aug 01 16:23:27 A10F63 systemd[1]: Started Rotate log files.
Aug 01 16:23:33 A10F63 Connectd[770]: Connectd Target built Jul 12 2023 at 03:10:55
Aug 01 16:23:33 A10F63 Connectd[770]:    Version 4.18.3.1689131372 - (c)2019 remot3.it, Inc. All Rights Reserved
Aug 01 16:23:33 A10F63 systemd[1]: remoteit@d9eb5a5.service: Can't open PID file /run/remoteit-d9eb5a5.pid (yet?) after start: No such file or directory
Aug 01 16:23:33 A10F63 Connectd[770]: Starting up as daemon
Aug 01 16:23:33 A10F63 remoteit.sh[770]: Connectd built Jul 12 2023 at 03:10:55 Now Starting Up
Aug 01 16:23:33 A10F63 remoteit.sh[770]:    Version 4.18.3.1689131372 - (c)2023 remot3.it, Inc. All Rights Reserved
Aug 01 16:23:33 A10F63 remoteit.sh[770]:    Built with arm-linux-gnueabihf-gcc tools ALIGN BCASTER LINUX RESOLVE BIGBUF BACKTRACE NATIVE_MALLOC
Aug 01 16:23:33 A10F63 remoteit.sh[770]:    Raspberry Pi Version
Aug 01 16:23:33 A10F63 remoteit.sh[770]: Starting up as daemon
Aug 01 16:23:33 A10F63 remoteit.sh[770]: PID file specified as /var/run/remoteit-d9eb5a5.pid
Aug 01 16:23:33 A10F63 remoteit.sh[770]: setting web config port to dest_server_port 80
Aug 01 16:23:33 A10F63 remoteit.sh[770]: init fe state 1
Aug 01 16:23:33 A10F63 remoteit.sh[770]: primary local ip = 155.245.23.56
Aug 01 16:23:33 A10F63 Connectd[770]: Parent Exited Normally.
Aug 01 16:23:33 A10F63 systemd[1]: Started Remote tcp connection service d9eb5a5.
Aug 01 16:23:33 A10F63 Connectd[792]: Begin Startup.
Aug 01 16:23:33 A10F63 Connectd[793]: Creating pidfile /var/run/remoteit-d9eb5a5.pid with PID 793
Aug 01 16:23:33 A10F63 Connectd[793]:   Using device uid = 90:00:00:00:00:05:83:5d
Aug 01 16:23:33 A10F63 Connectd[793]: initialize TCP target 127.0.0.1 port 65535
Aug 01 16:23:33 A10F63 Connectd[793]: 61241> Remot3it Registration Code Provided (checkhash 1f:32)
Aug 01 16:23:33 A10F63 systemd[1]: remoteit-refresh.service: Succeeded.
Aug 01 16:23:34 A10F63 Connectd[793]: 61251> sending req auth to 54.218.6.237:5959
Aug 01 16:23:34 A10F63 Connectd[793]: 61252> Status redirect to  44.240.35.27:5960
Aug 01 16:23:34 A10F63 Connectd[793]: 61252> sending req auth to 44.240.35.27:5960
Aug 01 16:23:35 A10F63 Connectd[793]: 61254> NAT type selected at 3 with natmap 2
Aug 01 16:23:35 A10F63 Connectd[793]: Server Connection changed to state 4
Aug 01 16:23:35 A10F63 Connectd[793]: Server Connection changed to state 5
Aug 01 16:23:35 A10F63 Connectd[793]: Connected to server is 44.240.35.27:5960
Aug 01 16:23:56 A10F63 systemd[1]: apt-daily.service: Succeeded.
Aug 01 16:23:56 A10F63 systemd[1]: Started Daily apt download activities.
Aug 01 16:23:56 A10F63 systemd[1]: Starting Daily apt upgrade and clean activities...
Aug 01 16:24:30 A10F63 systemd[1]: apt-daily-upgrade.service: Succeeded.
Aug 01 16:24:30 A10F63 systemd[1]: Started Daily apt upgrade and clean activities.
Aug 01 16:24:30 A10F63 systemd[1]: Startup finished in 3.725s (kernel) + 1min 57.829s (userspace) = 2min 1.555s.
Aug 01 16:28:29 A10F63 systemd[1]: Started OpenBSD Secure Shell server per-connection daemon (155.245.23.53:49167).
Aug 01 16:28:29 A10F63 sshd[897]: Accepted password for debian from 155.245.23.53 port 49167 ssh2
Aug 01 16:28:29 A10F63 sshd[897]: pam_unix(sshd:session): session opened for user debian by (uid=0)
Aug 01 16:28:29 A10F63 systemd-logind[269]: New session 4 of user debian.
Aug 01 16:28:29 A10F63 systemd[1]: Started Session 4 of user debian.
Aug 01 16:28:29 A10F63 systemd[1]: Started OpenBSD Secure Shell server per-connection daemon (155.245.23.53:49168).
Aug 01 16:28:30 A10F63 sshd[899]: Accepted password for debian from 155.245.23.53 port 49168 ssh2
Aug 01 16:28:30 A10F63 sshd[899]: pam_unix(sshd:session): session opened for user debian by (uid=0)
Aug 01 16:28:30 A10F63 systemd-logind[269]: New session 5 of user debian.
Aug 01 16:28:30 A10F63 systemd[1]: Started Session 5 of user debian.


Now sudo systemctl list-unit-files --state=enabled gives: (no change)

0 unit files listed.
debian@A10F63:~$ sudo systemctl list-unit-files --state=enabled
UNIT FILE                              STATE
tmp.mount                              enabled
autovt@.service                        enabled
bluetooth.service                      enabled
checklock.service                      enabled
cron.service                           enabled
dbus-org.bluez.service                 enabled
dbus-org.freedesktop.network1.service  enabled
dbus-org.freedesktop.resolve1.service  enabled
dbus-org.freedesktop.timesync1.service enabled
dhcpcd.service                         enabled
generic-board-startup.service          enabled
getty@.service                         enabled
ifupdown-wait-online.service           enabled
iptables-openvpn.service               enabled
it.remote.cli.service                  enabled
networking.service                     enabled
ntp.service                            enabled
openvpn.service                        enabled
pmsrv.service                          enabled
redis-server.service                   enabled
redis.service                          enabled
remoteit-refresh.service               enabled
rsync.service                          enabled
rsyslog.service                        enabled
schannel.service                       enabled
ssh.service                            enabled
sshd.service                           enabled
syslog.service                         enabled
system_maintenance.service             enabled
systemd-boot-check-no-failures.service enabled
systemd-networkd-wait-online.service   enabled
systemd-networkd.service               enabled
systemd-resolved.service               enabled
systemd-timesyncd.service              enabled
ufw.service                            enabled
pcscd.socket                           enabled
ssh.socket                             enabled
systemd-networkd.socket                enabled
ctrl-alt-del.target                    enabled
reboot.target                          enabled
remote-cryptsetup.target               enabled
remote-fs.target                       enabled
runlevel6.target                       enabled
apt-daily-upgrade.timer                enabled
apt-daily.timer                        enabled
fstrim.timer                           enabled
logrotate.timer                        enabled


Isnt,t that remoteit is not running at start since ps aux | grep remoteit found nothing after restart?

Ps: running remoteit status gives -bash: remoteit: command not found

I think there is some confusion over what is installed.
Did you install the Remote.It CLI as well? It is not compatible with the Remote.It device package. The CLI is what responds to the remoteit commands.

Can you look to see if you have a /etc/remoteit/config.json file? Please send the contents in a private message to me.

1 Like

Ok these have been sent to you on PM

Here is the recap of the issue. Both CLI and device package were installed on this device. They are not compatible to run at the same time and caused process errors. Solution was to uninstall the CLI by finding the binary and running the uninstall command on it. Then re-install the device package.
Originally the device had CLI installed by another user. It had been working correctly for some time, then after one reboot it didn’t come back online again. It is suspected that the device which is lower powered and had some issues with restarts/network at one point, CLI stopped trying to connect the Remote.It servers for presence even though it was running.
Then the device package was installed on top of this, which would allow the device to be online for a period of time, but because both CLI and device package were installed. Then when a reboot occurred, CLI would start up first and wipe out the config file, but it wouldn’t update the config because the machine identity didn’t match.
We had to uninstall the CLI (which wasn’t needed in this case because an outbound connection via Remote.It was not needed, only inbound). Then we removed the Remote.It device package using apt purge remoteit. Then we re-installed the device package.

1 Like

After a zoom session with the great remoteit team, turned out that a version of remoteit Cli was also installed there. I was deleting the device remoteit version but the CLI one was always there so when i rebooted the device, the device remoteit and the CLI were conflicting with each other which prevented the session from starting. Many thanks to Brenda and her colleague