MemoryVerse: Immersive 3D memories in space and time.

INTRODUCTION

Human history has been a continuing attempt to preserve our lives in the memory of ourselves and others. Sixty-six thousand years ago we began to record our experiences on cave walls, drawing representations of ourselves, our families and our environment in an attempt to memorialize who we were, what we did, and what our brief lives were about.

‍

The written word allowed us to tell more precise stories of our lives, pushing further and further until it happened . Using a pinch of math and a smattering of light, we converted our celluloid experiences into ones and zeroes and the Digital Age began.

‍

More people than ever can now capture, store, and share their memories, anytime and anywhere. Yet with all our cleverness we never broke free from the shackles of passive observation.

‍

But what if we could go back in time to the cave and stand with the painter, walk around as he paints, hear the dwindling crackle of the fire, sit down near his sleeping family and look up as he paints the story of their lives?

VISION

Welcome to the MemoryVerse, a Project dedicated to building technology to preserve human memories in 3D space and time.

‍

The future of digital life is a photorealistic medley of experience that MemoryVerse aims to build. The content medium of the future will go beyond today’s 2D video and into a world of immersive 3D memories captured in space and time . MemoryVerse will be an integral part of this future by providing an AI-enhanced application for recording, creating, and sharing immersive 3D experiences in real life. Each Memory is authenticated and anchored to its real world location and time, thus creating a digital immortality where no one is ever lost.

Experience

"More real than real"

‍

Memories are captured using using existing consumer-grade hardware (ie latest-gen iPhone camera optics, processing, NeRF, generative AI and when applicable LiDAR). The captures are authenticated and pinned to the blockchain and converted to photorealistic 3D environments, using advanced AI to fill in missing visual and spatial information.

Memories are visually indexed in space and time and keyword searchable on a virtual Earth interface.

Technology

The MemoryVerse system has three foundational, interoperable components:

COMPONENT 1

Memory Capture, Authentication and Photorealistic Representation Software — Developing Capture AI software for Memory Makers to record raw data from which Memories can be processed and rendered.

COMPONENT 2

AI-enhanced Memory Processing and Enhancement — Developing algorithms to analyze, process and render Memories from captured data, as well as generative AI models to continuously improve Memory reconstruction and recreate true life-like experiences.

COMPONENT 3

User Interaction Developing an intuitive UX for Makers and Explorers, allowing for easy Memory creation and an engaging Memory search and view experience via visual search mapping.

We believe that MemoryVerse, as the technology of human memories, should be public and decentralized by design. MemoryVerse technology consists of an evolving system of off-the-shelf computational hardware, cutting-edge AI / machine learning and computer vision research, and open source standards.

The MemoryVerse ecosystem consists of users who participate by contributing the raw data and processing capacity from which 3D memories are constructed. MemoryVerse participants create, view, and explore memories and provide the hardware and software infrastructure for memory creation, storage and retrieval.

Team

The MemoryVerse Project team consists of distinguished researchers, academics and Academy Award-winning technologists coming together to build a new system that allows anyone, anywhere on Earth to capture, store, and retrieve fully immersive human memories in 3D space and time. Imagine reliving a chess game with your grandfather or perhaps your child's first birthday or a New Year's celebration with friends.

George Borshukov

MV Memory Capture + Representation

MS Engineering & CompSci, UC Berkeley

Technical Designer: Bullet Time & Universal

Capture, The Matrix movies.

MetaHuman at Epic Games,

Electronic Arts R & D Director

Multiple Sci-tech Academy Awards

Global Innovator of 3D Computer Graphics

Vaughn Tan

MemoryVerse Dynamics & Ecosystem

AB, AM, PhD, Harvard University

Asst. Professor of Strategy

University College London,

Past: Ex-Google (Earth, Maps, StreetView)

Author: The Uncertainty Mindset

Utility Mechanics

Paul Cross

MemoryVerse Project Development Lead

BS, UWF. Past: Silicon Graphics Inc,

Ticketbud, Everfest

Global Wildlife Conservation

Surfrider Foundation, EFF, SFJazz

Michael Wei

MemoryVerse Product

BS Electrical & Computer Engineering

UT at Austin

Coinbase

Past: Tagomi, AMD Athlon64

Product Engineering

Sci-Fi and Gaming Enthusiast

Andy McErlean

MemoryVerse UX

BFA Honors, Auburn University

Product Design: Jasper.ai

Past: Bill.com, Divvy

Web 3 Product Design

Daisuke Sakai

MemoryVerse Experience

ID & Info studies MS, BS Robotics

University of Tokyo

teamLab Co-founder & COO

Wearable remote control systems, Humanoid

Robots, Interactive Digital Art

(Award-winning global installations)

Tony Wasserman

Prof. of Software Mgmt (Carnegie Mellon)

Founder/CEO (Interactive Dev. Environments)

Fellow: IEEE, ACM, IFIP

PhD, U. of Wisconsin, Madison

AB, UC Berkeley

Dan Stuart

Decentralized Hardware Systems

CTO (Penguin Computing); SGI

AI and Visual Simulation (at Scale)

Lead Systems Architect of the RSC by Meta

Open-source hardware/software.

George Hull

Visual Effects Art Dir (Industrial Light & Magic)

Conceptual Designer: (Dune, Blade Runner 2049,

Elysium, Cloud Atlas)

ADG Award for Excellence: Dune

BFA, U. Cincinnati

Aashiq SHAIKH

Memory Capture

AR/XR Neural Radiance Field Researcher

(Meteor Studio)

MS, PhD (cand.), Arizona State

Peter Norvig

AI Advisor

Director of Research (Google)

Researcher (NASA Ames Research Center, Sun Microsystems, USC)

Co-author of Artificial Intelligence: A Modern Approach

Fellow: ACM, AAAI, Stanford Institute of Human-Centered AI

PhD, UC Berkeley; BS, Brown U

More info

For detailed information on the MemoryVerse please request the project’s white paper .

The MemoryVerse Project seeks partnerships from foundations, university and research institutions. For partnership interest, please contact: MemoryVerse Project .

100% of all intellectual property created by the MemoryVerse Research team is open-source.

(Center for Memory Reconstruction)

Twitter

Memoryverse