Issue with writing to /usr/share/elasticsearch/data/elasticsearch

[jobrieniii]

Unable to launch elasticsearch container when trying to mount data to volume using Docker version 1.6.2, build 7c8fca2.

Simple example as shown in docs:

docker run -v "$PWD/esdata":/usr/share/elasticsearch/data elasticsearch

returns error (in this case I was using boot2docker):

- ElasticsearchIllegalStateException[Failed to obtain node lock, is the following location writable?: [/usr/share/elasticsearch/data/elasticsearch]]
    IOException[failed to obtain lock on /usr/share/elasticsearch/data/elasticsearch/nodes/49]
        IOException[Cannot create directory: /usr/share/elasticsearch/data/elasticsearch/nodes/49]

I also had tried similar command on centos 7 and get similar error (always goes back to the inability to write).

I had been running similar container run command with Docker version 1.5.0-dev, build fc0329b/1.5.0 a week or so ago - and had no problems.

Anyone seen this in recent docker builds?

[joshuacox]

possibly a perms issue, I'm having issues with the data dir as well.

chown -R elasticsearch. /usr/share/elasticsearch/data

from within the container, and that corrected some of my problems. That might correct your issues, alas elasticsearch is still not seeing my old data.

[tcabanski]

I see this error when using boot2docker on Mac with the latest image.

[joshuacox]

You might post the output of ls -lR /usr/share/elasticsearch/data from inside the container

[tcabanski]

I can't run a command on the container if I attach the volume because it fails during startup. If there's a way around that, please let me know. Here's the output without the volume attached:

Toms-MacBook-Pro:docker tom$ docker exec search ls -lR /usr/share/elasticsearch/data
/usr/share/elasticsearch/data:
total 4
drwxr-xr-x 3 elasticsearch elasticsearch 4096 Jun 7 16:32 elasticsearch

/usr/share/elasticsearch/data/elasticsearch:
total 4
drwxr-xr-x 3 elasticsearch elasticsearch 4096 Jun 7 16:32 nodes

/usr/share/elasticsearch/data/elasticsearch/nodes:
total 4
drwxr-xr-x 3 elasticsearch elasticsearch 4096 Jun 7 16:32 0

/usr/share/elasticsearch/data/elasticsearch/nodes/0:
total 4
drwxr-xr-x 2 elasticsearch elasticsearch 4096 Jun 7 16:32 _state
-rw-r--r-- 1 elasticsearch elasticsearch 0 Jun 7 16:32 node.lock

/usr/share/elasticsearch/data/elasticsearch/nodes/0/_state:
total 4
-rw-r--r-- 1 elasticsearch elasticsearch 67 Jun 7 16:32 global-1

[joshuacox]

docker ps -lq is that to grab the id of the last container ( in this case you should have started the ES container last), then docker logs -f $CONTANER_ID where CONTAINER_ID is what you got from the previous command, or throw this in your /usr/local/bin https://raw.githubusercontent.com/joshuacox/freezing-cyril/master/src/LogDockerLast
and what do the logs look like?

[tcabanski]

Logs are as follows:

[2015-06-10 12:10:59,770][INFO ][node ] [Arclight] version[1.4.5], pid[1], build[2aaf797/2015-04-27T08:06:06Z]
[2015-06-10 12:10:59,771][INFO ][node ] [Arclight] initializing ...
[2015-06-10 12:10:59,775][INFO ][plugins ] [Arclight] loaded [], sites []
{1.4.5}: Initialization Failed ...

• ElasticsearchIllegalStateException[Failed to obtain node lock, is the following location writable?: [/usr/share/elasticsearch/data/elasticsearch]]
  IOException[failed to obtain lock on /usr/share/elasticsearch/data/elasticsearch/nodes/49]
  IOException[Cannot create directory: /usr/share/elasticsearch/data/elasticsearch/nodes/49]

[koogle]

I can also confirm this issue
boot2docker/boot2docker#581 might be the reason

[whgibbo]

I'm new to ElasticSearch.. I download it on a windows 8.1 system and I'm getting the same issue.
Tried on a Windows 7 system and no issues.

Save version of Java on both by the way.

[joshuacox]

I'd kind of like to know why variable data is being stored in /usr anyhow? It makes it look like we have no idea about unix conventions, nor that variable data is stored in /var

[richie5um]

In case it is helpful to anyone else, I used the tip provided by @bradgessler (boot2docker/boot2docker#581 (comment)). Adding this to my Dockerfile resolved the problem:
RUN -usermod 1000 elasticsearch

[joshuacox]

@richie5um did you mean perhaps?

RUN usermod -u 1000 elasticsearch

[richie5um]

@joshuacox Oh, yes, thanks. Fixed.

[Kamapcuc]

I have the same problem with new ES1.7 on Windows7 and "subst" disk.
ES1.4 works fine with subst.

[saxix]

any updates on this issue ? I'm running the same on 5.1/5.2

[zelgerj]

yes same here. are there any updates?

[wybrono]

I encountered the same problem, because there is another es process has been opened, not be killed

[zelgerj]

so you got a solution or was is just a notice?

[matajaz]

Maybe same problem as discussed in: https://discuss.elastic.co/t/cant-create-lock-file-when-sharing-data-path-folder-between-docker-and-host/81617

[equivalent]

this helped me https://stackoverflow.com/questions/55361281/when-running-docker-compose-up-whith-elasticsearch-image-throwing-java-error/55361282#55361282