Updated UI, added date search, search queries and datestamps

.gitignore

@@ -1,4 +1,12 @@
-env/*
-sms/db
+.Python
+bin/
+include/
+lib/
+pip-selfcheck.json
+
+sms/db/*.db
+*.db-shm
+*.db-wal
+
 *.pyc
-*.swp
+

Dockerfile

@@ -0,0 +1,7 @@
+FROM python:2.7-buster
+
+COPY sms /sms
+COPY requirements.txt /
+RUN pip install --no-cache-dir -r requirements.txt
+
+ENTRYPOINT ["python", "/sms/manage.py", "runserver", "0.0.0.0:8000"]

README.md

@@ -1,43 +1,90 @@
 iMessage SMS database browsing web app
 ======================================
+This is a fork of jsok's repo [here](https://github.com/jsok/django-imessage). I have refactored some of the code, added functionalities and will continue to added functionalities to it as it seems to be a useful tool that elegantly solves a widely researched and discussed topic, how to read and search Apple's iMessages.
+
+The readme below is a modified version of jsok's to reflect the changes I've made.
 
 What?
 -----
-iOS stores all your SMS/Messages in a sqlite database. This gets downloaded to your computer each time you backup/sync your phone via iTunes.
+iOS and OSX store all your iMessages/SMS texts in a sqlite database. This gets downloaded to your computer each time you backup/sync your phone via iTunes.
 
-This is a django app which allows you to drop your SMS database into it, fire it up and have all your messages in a nice browseable web app.
+This is a django app which allows you to drop your iMessage/SMS database(s) into it, fire it up and have all your messages and databases in a nice browseable web app. In addition to just viewing your messages, you can also filter by date and/or query search terms.
 
 Why?
 ----
-Why not? iOS will only show the most recent 100 or so messages on the screen, to view older ones you need to hit "Load Earlier Messages" and wait. Too bad if you want to see messages from last month, or even last year! With this app you can see them all and search them.
+Why not? iOS and OSX will only show the most recent 100 or so messages on the screen, to view older ones you need to hit "Load Earlier Messages" and wait. Too bad if you want to see messages from last month, or even last year! With this app you can see them all, go to a specific date for a conversation and/or search them.
 
 How?
 ----
-The SMS database has been analysed by many and its schema is well known. I've taken some of this info and used it to convince django's ORM into reading it.
+The iMessage/SMS database has been analysed by many and its schema is well known. I've taken some of this info and used it to convince django's ORM into reading it.
+
+**For iOS:**
+
+If you have a jailbroken device:
+
+* SSH into your device
+* Navigate to `/var/mobile/Library/SMS/`
+* scp sms.db to your computer
+
+If you do not have a jailbroken device or you do not want to use ssh:
+
+* Backup your iphone locally on your computer
+* Navigate to `~/Library/Application Support/Mobile Sync/Backup/<device id>/3d0d7e5fb2ce288813306e4d4636395e047a3d28`
+* Copy the db file somewhere
+
+**For OSX**
 
-You can find the database in your iOS backup:
-`~/Library/Application Support/Mobile Sync/Backup/<device id>/3d0d7e5fb2ce288813306e4d4636395e047a3d28`
+* Open terminal.app
+* Navigate to `~/Library/Messages/`
+* Copy chat.db somewhere
+
+As of OSX 10.15 and with iCloud message sync on it seems like users cannot access the `~/Library/Messages/` directory (I cannot confirm when or what caused this) so do the following steps instead:
+
+1. Open terminal.app
+2. `open ~/Library/Messages/`
+3. Copy `chat.db` to the cloned github directory
 
 Screenshot
 ----------
-![Screenshot](https://raw.github.com/jsok/django-imessage/master/screenshot.png)
+![Screenshot](https://raw.github.com/clayshieh/django-imessage/master/messages_screenshot.png)
 
 Setup
 -----
 Requirements are:
  - django 1.4
- - pytz (for timezone info)
- - [UiUIKit 2.1](http://code.google.com/p/iphone-universal/)
+ - pytz
+
+1. edit `core/settings.py` and set your TIME_ZONE (list of timezones [here](https://en.wikipedia.org/wiki/List_of_tz_database_time_zones))
+2. Then drop your iMessage/SMS database(s) in `sms/db/`
+3. run `python manage.py runserver`
+4. Navigate to `http://localhost:8000/databases/` and select the database you wish to view
+
+Navigate to `http://localhost:8000` for instructions in general
+
+Docker Setup
+------------
+1. [Install Docker](https://docs.docker.com/get-docker/)
+2. Run the container with the following command:
+`docker run -it -p 8000:8000 -v <path to chat.db or sms.db>:/sms/db/sms.db clayshieh/django-imessage:latest`
+3. Navigate to `http://localhost:8000`
+
+Updates
+-------
+9/22/2020
 
-1. edit `core/settings.py` and set your TIME_ZONE.
-2. Then drop your SMS database in `db/sms.db` (rename it).
-3. Unzip UiUIKit into `static/UiUIKit`
-4. run `manage.py syncdb`
-5. `manage.py runserver`
-6. Point your browser at `http://localhost:8000/messages`, where you can browse your messages.
+ - Dockerized the app and updated instructions for OSX
+ - I have not worked on or updated this app in quite a while. There have been a lot of changes in both iOS and OSX so if you have any issues while using the app please let me know
+ - I did not realize that issues cannot be opened on forked repos, I will be moving all the code to a new repo and leaving this repo as a pointer once I either get permission from [jsok](https://github.com/jsok) and refactor the code
 
 Future TODO
 -----------
- - Messages.app style timestamps (supressed timestamps when messages are received within a given time delta)
- - Some way of searching your messages
- - Group chat isn't yet supported
+ - ~~Messages.app style timestamps (supressed timestamps when messages are received within a given time delta)~~
+ - ~~Some way of searching your messages~~
+ - Update to Django 1.11
+ - Add support attachments if it is a OSX database
+ - Add contact import support to associate numbers with canonical names
+ - Add support for group chats
+ - Convert message data to REST endpoints so UI doesn't hang when loading
+ - Make setup process user friendly in terms of uploading user db, uploading attachments directory, etc.
+ - ~~Support multiple database selection~~
+ - ~~Add exporting functionality~~

requirements.txt

@@ -0,0 +1,2 @@
+Django==1.4
+pytz==2017.3

sms/core/__init__.py

@@ -0,0 +1 @@
+#sms.db

sms/core/settings.py

@@ -1,7 +1,6 @@
 # Django settings for sms project.
 import os
 from os.path import join
-import django
 
 PROJECT_ROOT = os.path.dirname(os.path.realpath(__file__)) + '/..'
 CORE_APP_ROOT = os.path.dirname(os.path.realpath(__file__))
@@ -16,7 +15,7 @@
 MANAGERS = ADMINS
 
 DATABASE_ENGINE = 'sqlite3'
-DATABASE_NAME = 'sms.db'
+DATABASE_NAME = open(join(join(PROJECT_ROOT, 'db'), "db.conf"), "r").read().strip()
 DATABASE_PATH = join(join(PROJECT_ROOT, 'db'), DATABASE_NAME)
 DATABASES = {
     'default': {
@@ -33,7 +32,7 @@
 # http://en.wikipedia.org/wiki/List_of_tz_zones_by_name
 # although not all choices may be available on all operating systems.
 # In a Windows environment this must be set to your system time zone.
-TIME_ZONE = 'Australia/Sydney'
+TIME_ZONE = 'America/Los_Angeles'
 
 # Language code for this installation. All choices can be found here:
 # http://www.i18nguy.com/unicode/language-identifiers.html

sms/core/urls.py

@@ -3,7 +3,11 @@
 from django.contrib import admin
 admin.autodiscover()
 
+from . import views
+
 urlpatterns = patterns('',
+    url(r'^$', views.index),
+    url(r'^databases/', views.databases),
     url(r'^messages/', include('messages.urls')),
     url(r'^admin/', include(admin.site.urls)),
 )

sms/core/views.py

@@ -0,0 +1,43 @@
+from django.shortcuts import render
+from django.conf import settings
+from os.path import join
+from os import listdir
+
+
+def index(request):
+    return render(request, 'home.html', {})
+
+
+def databases(request):
+    changed = False
+    files = listdir(join(join(settings.PROJECT_ROOT, 'db')))
+    dbs = []
+    for file in files:
+        if file.endswith(".db"):
+            dbs.append(file)
+    selected_db = settings.DATABASE_NAME
+    config_db = open(join(join(settings.PROJECT_ROOT, 'db'), "db.conf"), "r").read().strip()
+
+    if "select" in request.GET and request.GET["select"]:
+        select = request.GET["select"].strip()
+        if select != config_db:
+            with open(join(join(settings.PROJECT_ROOT, 'db'), "db.conf"), "w") as f:
+                f.write(select)
+
+            # Jank way of implementing the syncdb functionality below. Works because django hot reloads.
+            # from django.core.management import execute_from_command_line
+            # execute_from_command_line("syncdb")
+            with open(join(settings.CORE_APP_ROOT, "__init__.py"), "w") as f:
+                f.write("#" + select)
+
+            selected_db = select
+            config_db = select
+            changed = True
+
+    context = {
+        "databases": dbs,
+        "selected": selected_db,
+        "config_db": config_db,
+        "changed": changed
+    }
+    return render(request, 'db.html', context)

sms/db/.gitignore

@@ -0,0 +1 @@
+!.gitignore

sms/db/db.conf

@@ -0,0 +1 @@
+sms.db

sms/messages/fields.py

@@ -29,10 +29,15 @@ def db_type(self, connection):
 
 	def to_python(self, value):
 		super(IMessageTimeStampField, self)
+
 		try:
 			app_tz = timezone(settings.TIME_ZONE)
 			return datetime.fromtimestamp(value+self.IMESSAGE_DELTA).replace(tzinfo=app_tz)
-		except:
+		except ValueError:
+			# to handle new version of databases (OSX 10.13)
+			app_tz = timezone(settings.TIME_ZONE)
+			return datetime.fromtimestamp(value/1000000000 + self.IMESSAGE_DELTA).replace(tzinfo=app_tz)
+		except Exception:
 			return value
 
 

sms/messages/urls.py

@@ -2,5 +2,5 @@
 
 urlpatterns = patterns('messages.views',
     url(r'^$', 'index'),
-     url(r'^(?P<handle_id>\d+)/$', 'messages'),
+    url(r'^(?P<handle_id>\d+)/$', 'messages'),
 )