Overview
A marker-based augmented reality platform that connects print products with the digital world. Publishers upload images (magazine spreads, brochure pages, product packaging) to a cloud-based SaaS.
When a mobile app user hovers their phone over the printed image, the static picture comes alive: a video streams directly over the trigger image, transforming a flat page into an interactive experience.
The platform serves publishers and advertisers who want to extend print media with digital engagement: selling interactive ad placements, enriching editorial content, and tracking reader engagement in ways that print alone cannot deliver.
- Client: Media and publishing company operating at the intersection of technology and culture
- Industry: Media / Augmented Reality
- Project Type: Custom AR Platform Development
Challenge
The client’s core question: how do you transfer moving images into a regular book or magazine format? Print media engagement was declining, and static images couldn’t compete with digital content.
The client needed a platform that would let publishers bridge physical and digital — without requiring readers to navigate away from the page.
AR technology was evolving rapidly, with multiple SDKs, tracking approaches, and hardware ecosystems.
The client required an engineering team that could:
- Select the right tracking technology
- Build a scalable SaaS backend for media management
- Deliver a mobile app that worked reliably across devices with different camera capabilities.
Empeek was brought in to architect and build the platform — SaaS backend, mobile AR app, and media management pipeline.
The Solution: AR Scenarios and Use Cases
The platform supports multiple marker-based AR scenarios for print media:
Interactive magazine advertising. A publisher sells an interactive ad placement: the brand’s full-page print ad becomes a video commercial when scanned. The reader hovers their phone over the page, and the static image is replaced by a streaming video — product demos, brand storytelling, or promotional content. The publisher charges a premium for interactive ad slots, creating a new revenue stream from existing print inventory.
Brochure and catalogue enrichment. Product brochures link to demonstration videos, 3D model rotations, or instructional content. A furniture catalogue page shows a video walkthrough of the room setup; a travel brochure plays destination footage when scanned. This extends the lifespan of printed materials and reduces the need for reprints when content changes — the video can be updated server-side while the printed trigger image stays the same.
Educational publishing. Textbooks and educational materials use AR to show processes that static images can’t convey — a biology diagram animates into a cell division sequence; a historical photograph becomes a narrated video. The marker-based approach means no QR codes or URLs — the image itself is the trigger.
Product packaging. Packaging images trigger instructional videos, authentication content, or brand storytelling when scanned at the point of sale. The same printed packaging serves both shelf display and digital engagement.
Technical Stack
- AR Engine: Vuforia SDK for marker-based image recognition and tracking. Vuforia was selected over ARKit/ARCore for its cross-platform marker tracking capabilities — Vuforia’s image recognition handles a wider range of print resolutions, lighting conditions, and surface textures than native SDKs, which are optimized for markerless surface tracking rather than precise image target matching. Vuforia’s cloud recognition service supports large marker databases for publishers with extensive print catalogs.
- Mobile App: Unity with AR Foundation as the cross-platform layer, deploying to both iOS and Android from a single codebase. Unity’s rendering pipeline handles the video overlay compositing — positioning the streamed video precisely over the recognized marker with correct scale and orientation.
- Backend SaaS Platform: Node.js with REST API architecture. The SaaS dashboard allows publishers to upload trigger images and pair them with video content. Each image-video pair is stored as a marker-target association with metadata (campaign name, publication, expiration date, analytics tracking ID).
- Media Storage and Streaming: AWS S3 for video asset storage with CloudFront CDN for low-latency streaming. Videos are transcoded to adaptive bitrate formats (HLS) to accommodate varying mobile network conditions — a reader on a train with intermittent connectivity still gets a smooth AR experience.
- Database: PostgreSQL for marker metadata, publisher accounts, and campaign management. Redis for caching active marker databases served to the Vuforia cloud recognition service.
- Analytics: Custom analytics pipeline tracking scan events, scan duration, geographic location, and device type — giving publishers engagement metrics that print media has never provided.
How It Works
The AR pipeline operates in three stages:
- Marker registration (publisher side). The publisher uploads a print image and a video through the SaaS dashboard. The image is processed by Vuforia’s target management system, which extracts feature points — distinctive visual characteristics that the mobile app will use to recognize the image through a camera feed. The video is transcoded and stored on the CDN.
- Image recognition (user side). The mobile app’s camera feed is continuously analyzed by the Vuforia SDK, comparing captured frames against the downloaded marker database. When a match is found, Vuforia calculates the marker’s position and orientation relative to the camera — determining exactly where and at what angle the video overlay should appear.
- Video overlay and tracking. Once the marker is identified, the corresponding video streams from the CDN and is composited over the live camera feed, aligned with the marker’s position. As the user moves their phone, Vuforia’s tracking algorithm updates the overlay position in real time — the video stays locked to the printed image even as the viewing angle changes. If the marker moves out of frame, the video pauses and resumes when the marker is reacquired.
Explore a related case study Photo Watermarking App
Results & Impact
- Launched a production SaaS platform with multi-publisher support. The system supports independent content libraries, campaign management, and analytics dashboards — publishers manage their own marker-target associations without engineering involvement.
See the Service Booking Platform case study for another example of Empeek building a custom platform around structured user workflows.
- Created a new revenue stream from existing print inventory. Interactive ad placements command premium pricing — publishers sell AR-enhanced pages as upgraded inventory alongside standard print ads. (According to studies, 51% of consumers are more likely to purchase after seeing an AR ad, supporting the premium pricing model.)
- Extended print advertising with measurable digital engagement. In a comparable AR print campaign, interactive content generated 30%+ engagement, nearly 40% CTR, and a 42-second dwell time, demonstrating the potential of AR to add measurable digital performance to traditional print inventory.
- Added measurable digital engagement to physical media. The platform captures scan events, dwell time, location, and device information, giving publishers campaign-level engagement data. Comparable image-recognition AR campaigns have achieved 4+ minute average sessions, demonstrating how physical media can become a measurable digital interaction channel.
See a related case study Fleet Tracking Service
- Supported interactive AR experiences across variable mobile conditions. The platform combined CDN delivery with adaptive bitrate video streaming so AR content could be delivered across different network conditions. Comparable image-recognition AR implementations have achieved 4+ minute average sessions, demonstrating the engagement potential of fast, continuous AR content delivery.
Check Empeek’s offers for services in Mobile App Development and AI-Powered Health Software
(No Ratings Yet)
Loading...
