Update web container to include migrations (LAION-AI#2234)

Follow up to LAION-AI#2233 

* update website container to include migrations
* remove outdated prisma container
* update other containers for better layer caching.

This PR contains no behavioural changes.

More context:

We started using `prisma db push` to sync our web db prisma schema with
the db, with the intention of moving to migrations soon™, but we never
did this because we never needed it.

Now I wanted to add a new table to the database and realized that the
infrastructure for something like this is not in place.

I created an initial migration from the already available db scheme, to
be able to deploy this without losing any data, we would need to force
prisma to mark this migration as applied.

The command is as follows:
```
npx prisma migrate resolve --applied 20230326131923_initial_migration
```

This PR prepare the web docker container to have migrations as a first
class citizen.

Author: AbdBarho

.dockerignore

@@ -1 +1,2 @@
 **/node_modules
+website/.next

docker/Dockerfile.backend-worker

@@ -6,10 +6,10 @@ RUN mkdir /worker
 WORKDIR /worker
 
 COPY ./oasst-shared /oasst-shared
-RUN pip install -e /oasst-shared
+RUN --mount=type=cache,target=/root/.cache/pip pip install -e /oasst-shared
 
 COPY ./backend/requirements_worker.txt /worker/requirements.txt
-RUN pip install --no-cache-dir --upgrade -r /worker/requirements.txt
+RUN --mount=type=cache,target=/root/.cache/pip pip install --upgrade -r /worker/requirements.txt
 
 ENV PORT 8080
 EXPOSE 8080

docker/Dockerfile.prisma

@@ -31,7 +31,7 @@ COPY --from=builder /app/public ./public
 
 # Copy over the prisma schema so we can to `npx prisma db push` and ensure the
 # database exists on startup.
-COPY --chown=nextjs:nodejs ./website/prisma/schema.prisma ./
+COPY --chown=nextjs:nodejs ./website/prisma/ prisma/
 # Copy over a startup script that'll run `npx prisma db push` before starting
 # the webserver.  This ensures the webserver can actually check user accounts.
 # This is a prisma variant of the postgres solution suggested in

docker/Dockerfile.website

@@ -10,8 +10,10 @@ ARG SERVICE="worker"
 ARG APP_RELATIVE_PATH="${MODULE}/${SERVICE}"
 
 WORKDIR /worker
-COPY ./oasst-shared /tmp/oasst-shared
+
 RUN conda create -n worker python=3.10 -y
+
+COPY ./oasst-shared /tmp/oasst-shared
 RUN /opt/miniconda/envs/worker/bin/pip install /tmp/oasst-shared
 
 COPY ./${APP_RELATIVE_PATH}/requirements.txt .

docker/inference/Dockerfile.worker-full

@@ -1,25 +1,31 @@
 #!/bin/sh
-# wait-for-postgres.sh
-#
-# This script tries to connect to a postgres database and then runs
-#   `npx prisma db push`
-# It repeats until that setup completes (running multiple times will be a
-# noop).  Then, it'll run the next command provided.
-#
-# You don't need to provide the connection URL.  This reads it from the
-# DATABASE_URL environment variable which should be set.
-#
-# To run we suggest:
-#   ./wait-for-postgres.sh npm run dev
+
+# Wait for db & run migrations
+
+# You don't need to provide the connection URL.  This reads it from the DATABASE_URL environment variable
+# which should be set.
 
 set -e
 
-until npx prisma db push --skip-generate; do
-  >&2 echo "Postgres is unavailable - sleeping"
+# validate schema
+npx prisma validate
+
+# wait until the db is available
+until echo 'SELECT version();' | npx prisma db execute --stdin; do
+  echo >&2 "Postgres is unavailable - sleeping"
   sleep 1
 done
 
->&2 echo "Postgres is up - executing command"
+echo >&2 "Postgres is up - executing command"
+
+# TODO: replace this command with applying migrations: npx prisma migrate deploy
+# NOTE: because of our previous setup where we just synced the database, we have to "simulate"
+# the initial migration with this command:
+# npx prisma migrate resolve --applied 20230326131923_initial_migration
+# prisma will fail with the above command if resolve is already applied,
+# we might need to run the command with set +e
+npx prisma db push --skip-generate
+
 # Print and execute all other arguments starting with `$1`
 # So `exec "$1" "$2" "$3" ...`
 exec "$@"