Music and computing

Augmented harmonium

Challenge

Setting

Role




Tools

Insight

"Make a harmonium that matches the vocalist's pitch."

My personal lab, from June 2019 to present

* Researched what matters for a harmonium player
* Designed and built the circuit for the harmonium
* Wrote firmware for the harmonium's digital audio signal processing
* Practiced (& practicing) the performing art of accompanying a vocalist


C, harmonium

The derivation of the natural shruti ratios for harmonium accompaniment in Indian classical music is largely dependent on what the tanpura drones produce. Two tanpuras, with four strings each, together create a 'canvas' of ratios to choose from, depending on the raag being sung.

Marimba robot for Indian classical music

Challenge





Setting


Role






Tools

Insight

"Train a four-armed marimba playing robot, Shimon, to play Indian classical music by allowing it to take advantage of its inherent physical capabilities and limitations. How could a recurrent neural network allow Shimon to generate, perform and improvise Indian classical music with a human tabla player, such that it learns its own physicality in the process?"

Academic project, from August 2018 to May 2019, at Georgia Institute of Technology, Atlanta, US

* Performed beat detection for polyphonic audio and a realtime tabla
* Quantized, autocorrected and normalized continuous vocal contours
* Built & trained a recurrent neural net to generate pitches & durations
* Designed & implemented algorithms to plan paths of Shimon's arms
* Designed Shimon's gestures to express rhythm to a tabla player
* Employed objective measures to evaluate Shimon's performance


Keras, Python, Max/MSP, Dunya

Seemingly trivial data cleaning can improve the performance of the recurrent neural network by orders of magnitude when done thoughtfully. One way to ensure that the recurrent neural network generates music that is suitable for Shimon's arms, is to iteratively award or penalize the network based on the performance of the arms at playing the generated music.

Machine learning guitar techniques

Challenge


Setting


Role




Tools

Insight

"Train a machine to accurately recognize guitar playing techniques such as bend and slide. Ensure that the system works with various guitar tones."

A team of two, from August to December 2017, at Georgia Institute of Technology, Atlanta, US

* Compared machine learning with digital signal processing for the task
* Determined what audio features best represent guitar techniques
* Trained a support vector machine with over six thousand data points
* Used the machine to classify candidates in a polyphonic guitar solo


Matlab, libSVM, Melodia, Sonic Annotator, Sinica

Candidate selection was performed using digital signal processing, and was designed to have high recall and low precision, while classification, in the next step, used machine learning with high precision and low recall. When dealing with a dataset of multiple tones, ensure that all the tones are equally represented while training the machine.

Deep raga identification

Challenge





Setting


Role




Tools

Insight

"Identify ragas in north Indian classical music by classifying them into three categories using a convolutional neural network and a convolutional recurrent neural network. What determines the performance of the networks more, their architecture or the structure of the data fed to them, especially when the three ragas have few common notes?"

A team of two, from August to December 2018, at Georgia Institute of Technology, Atlanta, US

* Built multiple network architectures & compared their performances
* Experimented with various ways to input data to the neural network
* Tweaked hyperparameters to understand their effects on the results
* Carefully manipulated batch & hidden sizes to capture data insights


PyTorch, Python, Dunya

The performance of raga recognition highly depends on the length of the input to the neural network, as it must capture the temporal structure over a duration of at least one rhythm cycle. As expected, a convolutional recurrent neural network performed much better than a regular convolutional neural network at this task.

The musical key

Challenge


Setting


Role





Tools

Insight

"Analyze thirty seconds of polyphonic audio to find its musical key. How could the system be made robust to non-standard tuning frequencies?"

A team of two, from October to November 2017, at Georgia Institute of Technology, Atlanta, US

* Identified tuning frequency deviation using spectral peaks in audio
* Found pitch chroma in a three octave range between C3 & B5
* Readjusted semitone bands based on tuning frequency deviation
* Used Euclidean distance for major & minor profiles to estimate key
* Evaluated results against ground truth for tuning frequency and key


Matlab

While calculating at the block level, it makes more sense to use the mode or the histogram peak, instead of the mean, as the mean gets thrown off by spurious peaks. It is also important to note that the tuning system is assumed to be equitempered, and is independent of whether the tuning frequency is deviated from the standard A4 of 440 hertz.

Intelligent music assessment

Challenge




Setting


Role



Tools

Insight

"Use recurrent and convolutional recurrent neural networks to assess musical performances. Train the networks to correctly predict the performance scores along four evaluation criteria, namely, musicality, note accuracy, rhythmic accuracy and tone quality."

A team of two, from October to November 2018, at Georgia Institute of Technology, Atlanta, US

* Implemented the networks to learn from pitch data of performances
* Carried out both training and evaluation against ground truth
* Experimented with hyperparameter tuning & architecture tweaking

PyTorch, Python

While the recurrent layers allowed both the networks to capture long term features of the musical performances, having an additional convolutional layer helped in meaningfully summarizing these features in the form of assessment scores. The networks had to be trained on a graphics processing unit to allow high number of epochs in a relatively short time.

Applications using sound

Speech informatics

Challenge



Setting

Role




Tools

Insight

"What information could be, and has been, extracted from speech audio, and how? How could audio be used along with other technologies to improve store sales and security?

A team of three, from August 2019 to July 2022, based in Dallas, US

* Extracted speech content, tone, identity & sentiment
* Built pipelines for online & offline audio noise reduction/removal
* Developed deep learning based image/video analysis & classification
* Owned & built end to end infrastructure & firmware for IoT/edge


TensorFlow, Python, C++, AWS, GCP, TPU, STM32

In order to build sustainable as well as cutting edge technology solutions for a store chain that mostly uses conventional hardware and limited resources, the approach to research and development had to be reinvented. Though it may seem counterintuitive, work on machine learning was directly benefited after engineers, alongside user researchers, got a peek into how stakeholders used existing technology.

User experience of transfer over sound

Challenge



Setting


Role





Tools

Insight

"Use the ambient sound to transfer data between smartphones. Ensure that the transfer is not perceivable by users even though it uses audible range of frequencies."

A team of two, from May to August 2018, at ToneTag, a startup based in Bengaluru, India

* Prototyped various ways to represent data through sound
* User tested modulations of amplitude, frequency and phase

* Experimented with envelopes to avoid audible clicks at bit changes
* Employed unconventional ways to null feedback yet retain ambience
* Overcame audible beats by using nonstandard audio sample rates


Pure Data, Max/MSP, Matlab, Objective C, Juce, Open Sound Control

Since humans can't perceive phase modulation, we encoded binary data in phase values, thus leading to a seamless user experience. If a certain unconventional approach promises a great user experience, but doesn't seem technically feasible, do pursue it with makeshift arrangements, since, more often than not, they result in unanticipated ways to bypass the technical hurdle.

Interactive music concert video player

Challenge




Setting


Role




Tools

Insight

"Design interactions for a video player that is meant for viewing multiple video recordings of a music concert simultaneously. The interactions should allow users to seamlessly switch between videos at any point of time during the playback in a meaningful way."

A team of two, from August to December 2018, at Georgia Institute of Technology, Atlanta, US

* Performed user study to identify an ideal device for video interactions
* Designed interactions & rapid prototypes for multiple Mac app options
* Used microinteractions to build a seamless video-stitch experience
* Tested three options with users for pain points and opportunities


Python, Sketch, Invision, Swift

Even though there are many possible interactions that could allow the user the selectively switch between videos, the simplest and the easiest one to learn involved a single click on the musician of interest in the video frame. Since users generally have a very low attention span, reducing their cognitive load should be the primary goal of any interaction.

Modular sample player

Challenge



Setting


Role



Tools

Insight

"Build a sample player that could be used with a MIDI input. How could you map advanced musical gestures, like slides, using audio samples from a traditional musical instrument?"

A team of three, from January to April 2018, at Georgia Institute of Technology, Atlanta, US

* Researched interfaces of traditional Chinese and Indian instruments
* Brainstormed playing techniques on a two dimensional screen
* Prototyped and tested the user interface in JUCE


JUCE, C++

With bowing and plucking sounds of Erhu, though it is possible to create a non standard organic interface, which might allow users to better manipulate the sound, we chose to use a visual representation of strings since a novice user can relate to it well. Rapid prototyping is faster in tools such as Max/MSP as compared to in JUCE.

User experience of sound browsing

Challenge





Setting


Role




Tools

Insight

"Improve the browsing experience of the sound-library of EarSketch, a tool that helps to learn to code through music. What is the ideal way to browse audio, given its non-visual nature, the users' inability to easily express what they are looking for while searching for sounds, and the difficulty to visualize multiple audio search-results at once?"

Academic project, from January to April 2018, at Georgia Institute of Technology, Atlanta, US

* Observed expert users to notice tricks and hacks in browsing audio
* Brainstormed novel ways to visually represent audio content
* Performed data analysis to understand users' listening habits
* Built a modular sound browser to be integrated with EarSketch

Python, Sketch

Audio content analysis alone doesn't necessarily lead to the most relevant set of sound browsing results. Taking insights from past user behavior can, at times, be more productive than simply using machine learning.

Create music from surroundings

Challenge



Setting


Role



Tools

Insight

"Build an application that allows users to convert environment sounds into music. What could be the most intuitive way for the users to create music without any prior technical knowledge?"

Solo academic project, from November to December 2017, at Georgia Institute of Technology, Atlanta, US

* Brainstormed interactions to capture natural sounds
* Rapid prototyped ways to visualize and manipulate audio
* Built and refined the interface to allow easy application of effects

Processing, Max/MSP

The best way to help a layman create music is through rhythm structures. Even with complex sound design and information architecture in the background, ensure that the user interface is extremely easy to use, and not intimidating.

Audio interaction with environment

Challenge



Setting


Role



Tools

Insight

"Build an iPhone app that allows users to interact with their surroundings through audio. How could you use audio to enhance the users' experience of moving between physical spaces?"

A team of three, from September to December 2017, at Georgia Institute of Technology, Atlanta, US

* Brainstormed scenarios when users might move between spaces
* Prototyped for various micro and macro movements of the users
* Designed, built and tested the audiovisual interface for the app

Pure Data, Objective C, Sketch, Invision

Users were able to relate to the various places mostly through the past associations that they had, of the sounds that were heard there. While designing for audio interactions, give minimal onscreen control to the user, especially when the audio is abstract.

Whistle controlled helicopter game

Challenge



Setting

Role




Tool

Insight

"Use sound interactively in David McCandless' helicopter game. Think of nontrivial applications of sound that could make the game more engaging and challenging."

My personal lab, in August 2015

* Brainstormed various ways of using sound in a game
* Rapid prototyped to test user engagement in input & output sounds
* Refined the experience with whistle as input in Processing
* Built more such whistle controlled games in the process

Processing

Mapping the second derivative of the input frequency makes this game easy for beginners, while at the same time, engages experts as the speed level increases. While designing a game, identify the one muscle memory that you would like the player to create and develop in the gameplay for the game to become addictive.

Hover perfect pitch

Challenge



Setting

Role




Tools

Insight

"Build a simple game that tests the player's perfect pitch. Set the difficulty level such that one can begin playing the game with only the basic knowledge of musical notes."

My personal lab, in August 2015

* Researched what makes a game challenging and addictive
* Rapid prototyped using Processing
* Tested the game with expert gamers as well as with novices
* Improved the gameplay iteratively

Processing

Differentiating between the sounds of the black and the white keys is trivial yet tricky. A gradual increase in the difficulty level of a game makes it addictive.

Tangible & audio interfaces

Improvising with machine

Challenge



Setting

Role



Tools

Insight


"Build a device which a musician could improvise with in realtime. How could the machine allow the user to experience improvisation in the style of their favorite musician?"

My personal lab, January 2017

* Brainstormed to identify rules behind music improvisation techniques
* Prototyped tangible interfaces for better control in live performances
* Implemented, and performed user testing with, a rule based system


Pure Data, Python, LMMS, Raspberry Pi

Algorithmic realtime improvisation works well in the beginning, while prolonged usage uncovers its repetitive behavior. Since music improvisation is sensitive to subtleties, small variation in the quality of data tremendously affects the statistical analysis drawn from it, and thus the musicality of such a data driven system.

Arm gesture audio effects

Challenge




Setting


Role




Tools

Insight

"Design intuitive gestures that could be effectively performed using Myo armband while singing or playing a musical instrument. How would you ensure minimum distraction while playing an instrument and performing the gestures simultaneously?"

Solo academic project in November 2017 at Georgia Institute of Technology, Atlanta, US

* Brainstormed gestures that cause minimal distraction
* Rapid prototyped linear audio effects using Max/MSP
* Tested arm gestures with users using Myo armband
* Incorporated machine learning in the iterative design process

Max/MSP, Myo armband, Wekinator (for interactive machine learning)

Only a simple gesture, such as vertical hand movement, can be seamlessly performed with very little practice. When gestures are meant to 'augment' an artistic practice, focus on unidirectional mapping.

Shadow controlled audio synthesizer

Challenge



Setting


Role



Tools

Insight

"Build an easy to use musical instrument meant to be played with one hand. How could the interaction be made interesting with only a few buttons?"

Academic project, for one week in January 2018, at Georgia Institute of Technology, Atlanta, US

* Brainstormed musical expression under constraints
* Rapid prototyped using a 555 timer and basic electronics
* Finalized the design considering ergonomics and visual balance

555 timer, light sensitive resistors

It is possible to build interesting interactions even without using a microcontroller (such as an Arduino). While designing an interactive musical interface such as this one, always start with musicality and usability, and then boil down to technology.

Webcam controlled audio manipulation

Challenge



Setting


Role



Tool

Insight

"Use input from webcam to meaningfully manipulate audio output of the computer. Use pattern recognition techniques for better analyze the webcam input."

Academic project in October 2017 at Georgia Institute of Technology, Atlanta, US

* Brainstormed visual ways to manipulate audio
* Rapid prototyped various visual-to-audio mappings
* User-tested one-to-one and many-to-many mappings

Max/MSP

One-to-one mappings are easy to build but might not be as intuitive as many-to-many mappings for the user. Always start with what the users might want to do with an interaction, instead of what is just technically feasible.

Gesture based audio manipulation

Challenge




Setting

Role



Tools

Insight

"Build a non obtrusive system using which you could manipulate audio through simple hand gestures. Pay attention to fine control over audio through precise hand movements that the user can learn and master over a period of time."

My personal lab, January 2016

* Tinkered with readily available equipment to sense hand movement
* Brainstormed parameters that could enhance the system's musicality
* Prototyped and tested the interactions with an artist and a layman


ATtiny45, Pure Data

When using a non touch based interface, such as mid air capacitance, it is important to identify the right parameters that are to be manipulated. To build new interactive musical systems that are expressive enough, focus on designing interactions with a 'high ceiling'.

Motion based fun instrument

Challenge



Setting


Role



Tools

Insight

"Build a handheld instrument which allows audio manipulation through hand movement. How could you achieve interesting effects with minimal interaction?"

Academic project, for one week in February 2018, at Georgia Institute of Technology, Atlanta, US

* Brainstormed ways to manipulate sound using simple movements
* Prototyped non obtrusive interface options, with minimal interaction
* Configured a palm sized system for ease of maneuvering


Arduino and peripherals

The dependence on both the ambient light and the movement of the hand gave sufficient degrees of freedom for the user to play casually, as well as to gain a level of expertise, with the system. While making tangible interfaces for handheld systems, consider ergonomics in terms of both its physicality and its learnability.

Heart box

Challenge



Setting


Role



Tools

Insight

"Build a minimal interactive rhythm instrument that is musically unique and easy to use for novices. Make the instrument self contained and easily portable."

Academic project, in March 2018, at Georgia Institute of Technology, Atlanta, US

* Rapid prototyped various simple percussion based systems
* Tested rhythm patterns that can be produced using just one surface
* Designed and built a heartbeat system with a readily available object

Arduino and peripherals

It was interesting to play with not only the acoustic properties of various readily available surfaces, such as this cardboard box, but also the variation in the perceived sound depending on the point of impact on a specific surface. While creating interactions that involve acoustic surfaces, try to first leverage the physical properties and the natural form of the object and its material.

Tap interaction musical instrument

Challenge


Setting

Role



Tool

Insight

"Use single touch interaction to control a melody. Use a modular tangible interface to invoke curiosity."

My personal lab, March 2016

* Explored modular possibilities with an ATtiny45 based system
* incorporated objects like vegetables to make the interaction fun
* Used step-play functionality to maintain a low learning curve

ATtiny45

Seemingly simple systems can involve a lot of complexity while they are designed. To make a physical system completely modular, think of how space could be allocated efficiently; for instance, no circuit board was used in this project.

Shadow musical instrument

Challenge


Setting

Role



Tools

Insight

"Create a fun interface using light and shadow to play with music. How could you make it easy to play with one hand, with minimal learning?"

My personal lab, May 2013

* Brainstormed meaningful ways to represent sound with shadows
* Prototyped interfaces using various light sources and orientations
* Augmented with a visual interface for an engaging experience


Arduino and peripherals, Processing

Although there was a scope of creating more complex interactions using an elaborate array of light sensitive resistors, I restricted the interface to a simpler one sensor per finger form to maintain 'low floor' (or low learning curve). Like how audio feedback complements visual feedback in general computational tasks (such as moving a file to trash), thoughtful visual feedback can improve the learnability of new musical interfaces.

Sound art research

Challenge





Setting



Role






Tools

Insight

"Use low cost components to research and build do-it-yourself tools to play with audio. Make sure that the tools have a 'low floor', so that kids can readily play with them, and a 'high ceiling', so that a professional sound artist can perform with them for hours and keep the audience engaged throughout."

A team of four, from November 2015 to May 2016, at Srishti Institute of Art, Design and Technology, an academic institute based in Bengaluru, India

* Invented open source kits that allow enthusiasts to tinker with sound
* Researched capacitance of microcontrollers for an ATtiny45 theremin
* Designed and built a 555 based modular synthesizer kit
* Built hardware oscillators, sequencers, filter envelopes and mixers
* Organized a 555 based robot musicianship workshop for kids
* Built a TR-808 drum machine based on Raspberry Pi and Pure Data

Python, ATtiny45, 555 timer, Raspberry Pi, Pure Data

While building do-it-yourself tools for people to build on, refrain from using pre existing tools such as an Arduino, because they prevent you from fully exploring unusual properties of basic components, such as the capacitance of a microcontroller, or the audio generation capabilities of a 555 timer. For creating a 'high ceiling', give flexibility and customization to the artist, in such a way that it ensures a refined control over the output for the audience.

Physical musical interface

Challenge




Setting

Role



Tools

Insight

"Use the interface of a traditional instrument, like a guitar, to create new sounds that are not generated acoustically, in order to expand the scope of possible interactions with the interface. Design interactions to demonstrate the uniqueness of the new sounds thus generated."

My personal lab, May 2016

* Prototyped new sounds for various traditional musical interfaces
* Redesigned sounds for guitar based on musicality and playing style
* Built a standalone and self booting sound processor for portability


Raspberry Pi, Pure Data, LMMS

Traditional musical interfaces have tremendous potential (as elaborated in my older blog post) to generate nuances that are not easily heard acoustically. Rejuvenating old interfaces through hardware/software innovation can lead to interesting results since these interfaces have evolved over decades if not centuries.

Audible icons

Challenge



Setting


Role



Tools


Insight

"What emotions do sounds provoke in us? How could short sounds be used to convey simple messages to denote acceptance, completion and error, for instance?"

Academic thesis project, from January to April 2011, at Indian Institute of Technology Guwahati, India

* Researched frameworks for feedback, feedthrough and feedforward
* Tested emotions induced by Classical notification sounds with users
* Created a framework of audible notifications based on meta analysis

Mental models, experience mapping, heuristic analysis, personas, scenarios, A/B testing, prototyping using Adobe Flash

The notes used in a notification sound, their sequence and transitions, their durations, the silence gaps between them, and the length of the overall notification sound, all play important roles in what emotion it induces in the user. Intuition, habit formation, and short term memory, in that order, help us decide what an audio notification means to us.

Metronome improviser

Challenge



Setting


Role



Tools

Insight

"Create a 'listening' metronome with which you can improvise. Since a metronome is a simple rhythm based system, add a physical character to it."

A team of three, in March 2018, at Georgia Institute of Technology, Atlanta, US

* Explored interesting mechanisms to build a physical metronome
* Used bells for the metronome and constructed a rotating structure
* Composed a musical piece with sections for three to improvise

Arduino and peripherals, Raspberry Pi

Thoughtful representation of circular repetitive motion of the system, and a visual feedback, gave the metronome a physical identity. Novice audience relate better to a structured rhythmic improvisation than to a more free flowing musical expression, which requires artists to have a clear aim before they plan a performance.

Augmented pencil paper interaction

Challenge




Setting

Role



Tools

Insight

"Create fun interactions using pencil and paper which can be used to manipulate on-screen visuals. What could be the quickest way for the user to grasp the correlation between scribbling on paper and computer graphics?"

My personal lab, June 2013

* Brainstormed ways to capture and represent pencil strokes
* Rapid prototyped interactions that are meaningful using a pencil
* Tested to compare the user experience with and without a pencil

Arduino, Processing

Though using a finger felt more natural, the pencil gave the user a better control over the gestures that were to be performed. New unusual interfaces may not necessarily provide a better user experience than traditional tools like a pen or a pencil do.

Hover interaction prototyping

Challenge



Setting

Role



Tools

Insight

"Create an application in Processing to prototype hover interaction using an Arduino and minimal external hardware. Use low cost and readily available components and simple techniques for rapid prototyping."

My personal lab, May 2013

* Brainstormed various ways of detecting a hovering finger
* Prototyped with everyday objects like mirror, paper, flashlight, etc
* Designed modular interactions in Processing for building apps

Arduino, Processing

Fairly complex physical interactions can be very easily prototyped using relatively simple hardware. While designing physical interactions, use a modular approach as it allows the interactions to be easily reproduced while building an application.

Interaction design for Lechal wearables

Challenge



Setting


Role






Tools


Insight

"Build wearables for the next generation of users. What are the best ways of designing, prototyping, building, testing and evaluating the experience of using wearables and tangible interfaces for various user groups?"

A team of four in a startup, from July 2013 to October 2015, based in Hyderabad, India

* Experimented with, and built up on, general interactive utility devices
* Reused game controllers, old phones and mice to build wearables
* Built weigh scales, pulse oximeters and thermometers into wearables
* Explored unique techniques such as bone conduction of audio
* Tinkered with wearables, making them suitable for user groups
* Built wearables for musicians, disabled, toddlers, athletes and pets

Arduino, peripherals, Processing, electronic components, customized chips, sensors, accelerometers, wireless modules, Bluetooth,

Since wearables always stay in close proximity of users, it is extremely important to clearly understand the needs and the pain points of the users, before starting to design and prototype. For building wearables with complex functionality, it is convenient to break apart existing products with that functionality and build up on them, in order to save time and resources throughout the iterative design process.

Mid air haptic interface

Challenge



Setting


Role




Tools


Insight

"Design interactions for a handheld television to leverage localized mid air haptic feedback on the user's palms. For what type of streamed content would such a feedback be appropriate?"

A research team of three, from May to July 2010, at University of Bristol, UK

* Researched existing interactive handheld devices and their users
* Performed meta analysis of haptics in human computer interaction
* Created personas, scenarios and storyboards to map user journeys
* Designed intuitive ultrasonic feedback to be felt on users' palms

C#, mental models, personas, experience mapping, A/B testing, prototyping

The exact placement of palms behind the display largely determined the haptic experience, thus making it tricky to design localized feedback. While working on a physical product, first design the user experience, and then decide how hardware should be built around it.

User centered design

User research for AWS

Challenge


Setting


Role






Tools

Insight

"How could AWS stay ahead of the competition, especially for industrial customers?"

A team of three at the leading cloud service provider, from September 2022 to present, based in Houston, US

* Led research within the AWS by advising design, product & tech
* Designed, analyzed & synthesized research insights/opportunities
* Influenced long-term strategy & direction of major AWS products
* Provided rigorous insights to influence tech investments
* Educated the broader Amazon community on research mechanisms
* Pioneered research into new spaces


Data analysis

It is important to track the impact of a real world finding, right from the origin of the need for the finding, all the way up to the business gain that the finding potentially leads to.

Experience design for Livspace

Challenge




Setting


Role





Tools

Insight

"Create online design tools for home decorators to communicate ideas effectively to their clients. Design a collaborative platform for multiple stakeholders, including decorators, vendors, customers, warehouse managers and digital artists."

A team of four in a startup, from June 2016 to July 2017, based in Bengaluru, India

* Performed user research with home decorators and stakeholders
* Brainstormed to understand pain points and opportunities
* Evaluated multiple existing workflows
* Rapid prototyped using Sketch and Invision
* Created visual design to be used with Zeplin

System mapping, A/B testing, prototyping using Sketch, Invision, Zeplin

It is important to clearly understand and differentiate between various user needs, especially when a platform is meant for multiple types of users. When user groups are interacting using a platform, the focus should always be on making their interaction as smooth as possible.

Interaction design for Lechal

Challenge




Setting


Role






Tools



Insight

"Design an iPhone app that accompanies Lechal smart shoes to help users, especially the visually impaired, navigate through visual, auditory and haptic feedback. Since the smart shoes can also track walking and running speeds, design with fitness and community aspects in mind."

A team of five in a startup, from July 2013 to October 2015, based in Hyderabad, India

* Performed thorough user research with visually impaired users
* Built several rapid prototypes using the Wizard of Oz technique
* Designed app wireframes using Justinmind
* Prototyped haptics in shoes with Arduino and Bluetooth module
* Designed, prototyped and tested foot gestures using accelerometers
* Carefully integrated features for accessibility, fitness and sharing

Personas, scenarios, heuristic analysis, usability testing, system mapping, experience mapping, prototyping using Justinmind, Processing, Arduino and peripherals

If a product expects users to learn a set of vibration patterns and a foot gesture language, keep the interaction as minimal as possible to avoid mental overload for users. While designing for wearables with accessibility features, pay close attention to the complete experience of interacting with the smartphone app, as well as the physical product.

Experience design for Carwale

Challenge



Setting


Role




Tools

Insight

"Redesign the e-commerce website of Carwale to allow easier comparison between car models. Create a compelling user experience that makes the website a one stop solution for users' automotive needs."

A team of three in a startup, from November 2012 to March 2013, based in Mumbai, India

* Brainstormed with the team to understand business objectives
* Designed tools such as equated monthly installment calculators
* Created wireframes using Axure RP
* Worked closely with graphic designers and front end developers

Personas, A/B testing, prototyping using Axure RP

Product comparison is a good way to get users engaged in product discovery, and to introduce them to micro tools such as installment calculators. While designing the experience of sub tools, it helps to keep the broader design goal in mind.

Interface design for Infosys

Challenge



Setting


Role



Tools


Insight

"Use existing internal design assets to create interfaces for varied applications. Build complex functionality into easy to use and intuitive interfaces."

A team of four in a multinational corporation, from July 2011 to October 2012, based in Bengaluru, India

* Designed information architecture for fairly complex applications
* Built end to end wireframes for mobile and web apps
* Used and contributed to user interface design toolkits

System mapping, scenarios, A/B testing, prototyping using Adobe Photoshop

Having a large number of steps to accomplish a specific task is acceptable if the user is kept aware of their current state of progress in the task. An interface becomes easy to use if the user has to do exactly one action at any point of time.

Interaction design for Redmelon Design

Challenge



Setting


Role


Tools

Insight

"Generate design ideas for a website of an upcoming Bollywood actress. Suggest visual elements that could make the website stand out among others of its kind."

A team of two in a design firm, for two weeks in December 2009, based in Mumbai, India

* Conducted brainstorming with stakeholders
* Created affinity diagrams, moodboards and paper mockups

Scenarios, prototyping using Adobe Illustrator

Flashy and animated visuals do not necessarily imply a great first impression. It is the Information architecture and the ease of navigation of a website that determine its experience and usability.

Interaction design for Dig Design Studio

Challenge



Setting


Role



Tools


Insight

"Build a game that teaches the language Konkani (which does not have a written script) to kids of age five to seven. Considering the age group, the interactions should be extremely intuitive and appealing."

A team of three in a design studio, from May to July 2009, based in Bengaluru, India

* Conducted user research with kids at a school
* Created paper mockups
* Prototyped, tested and built a game in Adobe Flash

ActionScript 3, personas, heuristic analysis, experience mapping, prototyping

The game, which involved multiple choice questions with prominent visuals, was highly engaging for the kids. Specifically for this age group, pay special attention to kids' natural distractions, and use them to your advantage as a designer.

Tejas Rode © 2009 - 2024