Enforce Unique: Seed user data with unique values, reduce collisions, and optimize queries.

Create seed data with unique valid usernames, enforce integrity, and safeguard against failures.

Generating Unique and Valid Usernames in Seed Data

[00:00] Before I actually enforce this uniqueness, I'm going to come down here and we're going to add a catch right here because if there is a problem creating one of these users, this isn't all that critical that we actually fail everything. I'd rather just have some seed data

[00:16] created rather than blowing up the whole seed script. This is especially useful if you're creating a lot of users and it takes a while and you're waiting and you're waiting, and then the second to last user, it blows up and you're like, that's so annoying. So yeah, we're going to just add a catch here, and we will just ignore the error entirely.

[00:36] So yeah, rather than what Copilot is saying, we're just going to say console.error, and then we'll just ignore it. It's fine. It's not a big deal. So that way, we could say error creating user. There we go. So now we're not going to have

[00:54] any problems if there's an error creating the user. But we're also going to reduce the likelihood of there being an error creating the user using the unique enforcer. So we're going to create a unique username enforcer by creating a new unique enforcer,

[01:13] and we don't need to specify any options or anything like that. So then we'll come over here and we'll use the username unique enforcer here by saying, our username actually comes from Enforce,

[01:29] and then here's our callback for generating that username. Now, we actually want to make some adjustments to this username as well to make sure that it conforms to our requirements in the database, some validation stuff. So we're going to do one thing to

[01:49] actually make it a little more likely to be unique, and then another thing to make sure that it stays within the bounds of what we want as far as our usernames are concerned. So here's what we're going to do. We're going to wrap this up like this.

[02:08] We're going to add a faker.string.alphanumeric with two characters, and then we'll have an underscore. So that way, this will not be count, it's length. So this way, we just have some random string.

[02:26] So even if we somehow managed to get the same first name and last name, we're still going to probably be unique because we have this random alphanumeric two-character code before any of our usernames. For these randomly generated users, that is perfectly fine. I don't really care about

[02:45] that for my local development and stuff. So once we have that, then we can add a couple of pieces of transformation to make sure that this matches up with our requirements. So we have slice 0-20 because we have a limit on our usernames to be 20 characters long.

[03:03] We also have our usernames as lowercase, so we'll add that. Then we also have a requirement on our usernames to be alphanumeric. So if there are any extra characters that are thrown in there by this random generator, we'll replace those.

[03:19] So replace anything other than A-Z and 0-9 with an underscore. That will make our generation of usernames a little bit more reliable and the username is used as part of the e-mail as well,

[03:37] so that will take care of that as well. Great. So let's run our seed scripts. Here we go, refresh that. So now we've got those alphanumeric characters at the beginning, no big deal. We've got our e-mails. Looks like we're missing Cody. I probably refreshed too early. Yeah, there's Cody. There's our usernames,

[03:56] matches the e-mail, and then our names. Like I said, it's pretty unlikely that we ever would have had this problem, but especially once you get a lot of generated data, it definitely can happen. So using this enforcer, unique enforcer, basically the idea is you just pass it

[04:13] this function and if it gets the same thing twice in a row, or twice in at all, then it will just call the function again and it will keep calling it until it times out or it runs out of iterations. I think it defaults to like 50 times or something like that, which of course is configurable as well.

[04:31] So that takes care of our username. Not only does it ensure that it's unique, but it also ensures that it falls within our requirements for what a username is. That as a general principle is a good idea to make sure that the seed data that you're generating falls within the requirements of

[04:51] your application and what validation you would have for those different fields. So there you go.

Creating Unique User Data with Enforce Unique Library

[00:00] You know how we have a unique constraint on both the username and email? This is very good. It will help our queries to email and username be a lot faster. And just like from a pure product standpoint, it makes a lot of sense for those things to be unique. In fact, we're going to log the user in with their username or email as well. So we need to have those be unique.

[00:19] The problem is in our seed data, we're not actually generating unique values quite yet. Like we're generating random values, and it's possible that two of these users could end up with the same unique value for the username and first name and last name and email and all that. It's unlikely, but definitely possible. It can happen.

[00:37] So I want you to update this create user utility so that it ensures that that is unique, at least in the process of running the seed, and that will reduce the chance of collisions. So we've got a library that we're going to use called Enforce Unique.

[00:55] So give that a look. And yeah, let's get this implemented so we don't run into some collisions. Have a good time.

Data modeling is as a critical skill for the full stack developer. After all, data is the foundation of your application.

If you don't do it right, you'll find yourself stuck before you even get started. A poorly designed database schema can lead to a lot of headaches down the road when you need to make changes or add new features. Inefficient queries can slow down your application, leading to a poor user experience. Analyzing root causes to issues like these can be a time-consuming and frustrating process.

Web developers spend a ton of time into making their UI handle a slow backend well which is great and you should do that too (you don’t control network latency after all). But *****great***** web developers put effort into making it so their users hardly ever experience that great pending UI by making the backend as fast as possible. Your UI can’t be any faster than your slowest database query.

The Data Modeling Deep Dive Workshop will help you develop a keen understanding of databases and how to manage them. You'll learn the same tools and techniques used at the top tech companies to design robust database architectures and optimize query performance.

We'll be using production grade tools like Prisma and SQLite, but the concepts you learn in this workshop will be applicable to other database systems as well.

## Database Schema

A well-designed database schema is the foundation of your application. It's critical to get it right from the start, as it can be difficult to make changes down the road. This section provides a background on SQL before introducing Prisma's suite of tools. You'll learn:

- SQLite database initialization with Prisma
- Prisma's Object Relational Mapper (ORM)
- Defining a schema with Prisma's declarative schema language
- Converting a schema to SQL with the Prisma CLI
- Viewing and editing your database in Prisma Studio

## Relationships

Poorly planned relationships between database models can lead to data inconsistencies and increased query complexities and performance problems. To avoid these issues, you need to understand the different types of relationships and how to implement them. This section provides you with practical experience in recognizing relationships:

- One-to-many relationships (User has many Notes)
- One-to-one relationships (User has one UserImage)
- Updating the database with Prisma
- Planning models for the future
- Generate an Entity Relationship Diagram (ERD) for visualization

## Migrations

As your application evolves, so will your database schema. It's not uncommon for there to be "breaking changes" that affects one or more of your database models. This is where migrations come in.

Migrations allow you to track and synchronize schema changes across environments. Traditionally migrations have been tricky to manage, but this section will teach you how to use migrations to ensure your development, staging, and production environments are always in sync:

- Generating SQL migration code with Prisma
- Best practices for documenting & tracking migrations
- The "widen then narrow" approach for eliminating downtime
- Experimenting with migrations before permanently applying them

## Seeding Data

Manually adding data to a database is not only time-consuming but also prone to errors. Scripting to the rescue!

Here you'll learn how to populate your databases with consistent data for development and testing purposes:

- Initializing a SQLite database
- Idempotent scripting
- Resetting the database with Prisma
- Nesting SQL queries to simplify foreign key connections

## Generating Seed Data

Using hardcoded seed data works great for small applications, but it won't provide the best idea of how your application will perform at scale. You also shouldn't use real user data during development for plenty of obvious reasons.

A better approach is to use a library like Faker.js. This section will teach you how to use Faker.js to generate seed data for your database:

- Balancing realism with practicality when generating data
- Creating realistic user information
- Varying data quantities and randomness
- Validating against the schema
- Enforce data uniqueness

## Querying Data

In SQL, queries are written with the `SELECT` statement. This is one of the most powerful statements available, but it can also be one of the most complex. This is where tools like Object Relational Mappers (ORMs) come in, helping developers write SQL in a more intuitive way. Although it isn't a traditional ORM, the Prisma Client is an indispensable tool for modern web development. In this section, you'll learn how to get the most out of it:

- Understanding how Prisma's API maps to SQL
- Handling Hot Module Replacement (HMR)
- Logging slow queries
- Pre-connecting the client to the database

## Updating Data

Data mutation is a common task, but doing it incorrectly can lead to data corruption or loss. Especially when a single user action results in multiple database changes (for example, transferring money between user’s bank accounts). Getting mutations wrong can be a serious problem for your app’s success. This section will walk you through techniques for working safely:

- Deleting and updating data
- Conditional upserts
- Combining multiple queries into a transaction
- Rolling back to a previous transaction

## SQL

No matter how great an ORM is, sometimes you have to write raw SQL. In this section, you'll learn how to write raw SQL queries and execute them with Prisma. You'll also practice with:

- Wildcard queries
- Runtime schema validation with Zod
- Using joins to enable more complex queries
- Specifying query result ordering for more efficient searching

## Query Optimization

Nobody likes a slow application.

There are many stories of companies spending millions of dollars on scaling hardware, adding multiple levels of caching, and even rewriting their entire application in pursuit of a faster performance– only to find out later that the solution was optimizing their database indexes and queries.

In this final section, you'll learn how to optimize your queries for maximum performance:

- Identifying the index
- Analyzing raw SQL queries
- Multi-column indexing
- Balancing premature optimization with practicality

The Data Modeling Deep Dive Workshop will teach you best practices for designing database schemas, managing relationships, data mutations, and optimizations.

Data Modeling Deep Dive

Kent C. Dodds

Full Stack Vol 1

Intro to Data Modeling Deep Dive Workshop

Intro to Data Modeling Deep Dive

Intro to Database Schema 

Learn how to set up your database using Prisma, including initializing the schema and configuring new files.

Learn how to create a SQLite database using Prisma, define models with unique fields, and explore data using Prisma Studio. 

Database with Prisma and SQLite

Setting Up the Database with Prisma

Dad Joke Break Database Schema

Database Schema

Intro to Data Relationships

Create a one-to-many relationship: Users own multiple notes; note model handles the relationship, user model stays unaware. 

Learn how to establish one-to-many relationships between models in Prisma, including configuring relationship attributes and avoiding common pitfalls.

One-to-Many Relationships in Prisma

One-to-Many Relationships 

Optimize image storage in a DB: no polymorphism, future-proof for web apps. Learn why it's best for new projects.

Master Prisma relationships: one-to-one, one-to-many, foreign keys, cascading, unique constraints. Dive into DB schema design flexibilities & limits.

One-to-One and One-to-Many Relationships in Prisma

Database Design

Dad Joke Break Data Relationships

Data Relationships

Intro to Data Migrations

Master Prisma migration: create tables, modify props, spin up DBs, deploy across environments with confidence.

Prisma migrations: Seamlessly evolve your DB schema, reap benefits of flexibility and easy updates.

Database Migrations with Prisma

Creating Migration Files for Database Management with Prisma

Dad Joke Break Data Migrations

Data Migrations

Intro to Seeding Data

Configuring Prisma for seamless data seeding using seed scripts in your application.

Creating and Managing Data with Prisma Seed Scripts

Configuring Prisma for Seed Script Execution

Leverage Prisma nested mutations for efficient data handling, query optimization, and seamless retrieval. 

Efficiently manage relational records with nested queries. Explore benefits and considerations of nesting in DB ops.

Nested Queries in Database Operations

Optimizing Queries with Nested Mutations in Prisma

Dad Joke Break Seeding Data

Seeding Data

Intro to Generating Seed Data

Automatically generate realistic fake data for efficient testing with powerful tools.

Use Faker.js for realistic random user and note data, automating database population matching your schema. 

Generating Random User Data with Faker.js for Database Seeding

Generating Fake Data for Efficient Testing

Effortlessly generate dynamic web app data: user profiles, images, notes, with time-saving techniques.  

Create dynamic seed data with Faker and Prisma: random users, notes, images. Boost data generation efficiency and flexibility.

Generating Dynamic Seed Data 

Dynamically Generating Data

Dad Joke Break Generating Seed Data

Generating Seed Data

Intro to Querying Data

Learn how to migrate from an in-memory database to a real database using Prisma and SQLite, enabling the loading of actual data in your application.

Optimize Prisma Client: Lazy connections, custom logging, and speed up app with query performance.

Optimizing Prisma Client for Efficient Database Operations

Connecting to a Real Database with Prisma and SQLite

Transition from in-memory to real database with Prisma, efficient SELECT queries for user data, type safety advantages.

Shift to Prisma SQLite DB, type-safe queries for specific fields, end-to-end type safety in web apps. 

Using Prisma to Retrieve User Data from a SQLite Database

Transitioning to Real Database with Prisma API

Learn how to optimize note loading by combining multiple queries into a single query and migrating to Prisma for real database integration.

Optimize data retrieval with Prisma, subselects for efficiency, TypeScript error-catching, and migration guidance. 

Efficient Data Retrieval with Prisma and Subselects

Database Queries and Migrating to Prisma 

Dad Joke Break Querying Data

Querying Data

Intro to Updating Data

Delete data from the actual database using Prisma. This exercise introduces a straightforward mutation before diving into more complex concepts.

Discover how easy it is to delete data using Prisma's syntax and APIs. 

Deleting Data with Prisma

Mutating Data with Prisma

Mutations for updating images and notes on a page, including cache control considerations and utilizing helpful utilities for easier data manipulation.

Learn how to update and delete data in a form using Prisma, while handling image updates, removing deleted images, and creating new images. 

Efficiently Updating and Deleting Data in a Form with Prisma

Updating Page Mutations for Images and Notes with Efficient Cache Control

Learn how to use transactions to ensure that data operations within your application either succeed completely or fail entirely. 

Learn how to use prisma.transaction to ensure a group of database operations either all succeed or all fail together

Implementing Transactions with Prisma for Atomic Database Operations

Implementing Transactions for Reliable Data Operations

Learn how to use nested queries in Prisma to combine multiple database operations into a single optimized query, reducing the number of calls made to the db. 

Learn how to optimize database updates using Prisma by combining multiple related queries into a single transaction, resulting in cleaner, more efficient code. 

Efficient Database Updates with Prisma's Nested Queries

Optimizing Database Calls with Nested Queries in Prisma

Dad Joke Break Updating Data

Updating Data

Intro to SQL

Master advanced user search with Prisma: Write raw SQL queries, iterate from basic search to SQLite database display.

Search users with Prisma raw queries by criteria, handle TypeScript hurdles, prep for adding images.

User Search with Prisma and SQL

SQL Queries for User Search in Prisma

Tackle TypeScript errors in Prisma raw queries, ensure type safety with Zod runtime checks. Weigh Prisma's trade-offs.

Embrace runtime type checks in Prisma for robust DB interaction, handle schema changes and parsing errors.

Runtime Type Checking and Parsing in Prisma with Raw Queries

Handling TypeScript Errors and Runtime Type Checking with Prisma and Zod

Efficiently combine data with SQL joins: inner, left, right, full. Get user profile photos without performance issues.

Master left joins in Prisma/SQLite, resolve conflicts, enrich schema, and improve UI with extra properties.

Left Joins with Prisma and SQLite

Working with Joins in SQL

Sort users by most recent note updates using Prisma raw SQL queries. Follow step-by-step instructions.

AI assistants like GitHub Copilot for SQL queries: benefits, best practices, code review, productivity, accuracy. 

Leveraging AI Assistance for Writing SQL Queries

Sorting Users by Recent Entry with Raw SQL

Dad Joke Break SQL

Intro to Query Optimization

Boost Prisma query performance: Add non-unique foreign key indexes, verify with 'explain query' for speed!

Optimize DB queries with user-specific note indexes, boosting performance and reducing scan times.

Optimizing Database Queries with Indexes

Optimizing Query Performance with Indexes in Prisma

Enhance slow user search with single index in SQLite, sidestep caching complexities, grasp query plans, and boost DB performance.

Learn how to analyze query plans and optimize query performance by adding indexes to improve speed and avoid unnecessary scans and temporary data structures.

Data Modeling Deep Dive

Data Modeling Deep Dive

Transcript

Creating Unique User Data with Enforce Unique Library

Transcript