Subscribe to Datalight's Blog


IoT Dev Conference

At last week’s Internet of Things Developers Conference held in San Jose demonstrating the value of IoT was clearly top-of-mind. There were predictions of the number of devices that would be part of the IoT ranging from 20 billion to 50 billion. One speaker mentioned that a 1% reduction in maintenance may increase profits by up to 15%. Another presentation described a smoke detector that not only detects the smoke and calls the fire department but also knows who is in the house and what room they are in Rather than just beeping, it can provide verbal instructions like “There is a fire in the kitchen, so leave immediately and go out through the garage door. The fire department has been notified and is on the way.” And for young kids, it uses Mom’s voice to talk to them so they don’t get scared. Obviously a highly controlled interconnected multi-device solution, but it can surly be done today!

A clear fundamental theme of the conference was security. Most every presenter mentioned it. Notably a panel on IoT Security offered: “We cannot make a device that’s fully secure, because there are always new and different security attacks. When we see a new attack we must do something different to cover that security hole, so being able to update the device is an ABSOULTE MUST.”

Other – There were several miscellaneous items I found interesting.

  • There were multiple Custom SOC vendors.
  • One custom CPU vendor had a low-end 32-Bit CPU that was built on only 7700 gates.
  • A new compiler is available that can easily enable custom instructions to be used by defining those custom instructions to the compiler. During code generation they will be used correctly, meaning you don’t have to change your C/C++ code to use fully custom instructions.
  • Dream Factory has a fully Open Source Server software that enables RESTful API’s to connect to IoT devices.  This server software is a LAMP solution that enables multiple database models.
  • Qualcomm promoted the idea that all the technology found in smart phones is needed for IoT­like the multi-sensor aggregation, security, audio and video.

One of the areas that I found especially fascinating is the state of computer vision and the fact that inexpensive IoT devices can use it today. Visual data offers perhaps the richest source of information about the real world:  people, places, and things. The low cost camera sensor and DSP technology makes computer vision cost effective. Computer Vision can enable a device to know your mood, know who is nearby, enable a computer to map out an area and plot a course to some new destination. One of the products that is using it is a new automatic vacuum cleaner that maps out the room and only vacuums any given spot once, not like the “old school” robotic vacuums that wander around randomly and just about wear out your carpet to get it clean. Having the DSP in the IoT device means that vision data need not be sent to the cloud to be processed, but only the metadata found the within the vision data.

The perspective of Cloud provides the storage and analytics was bantered around a bit. Yet one application that was referenced is that an Oil Rig generates about 2 terabytes of data per day and 99% of it is discarded as useless. Datalight has seen similar use cases in our work with airplane engine data recorders which generate about 1 terabyte per hour. The important data to communicate in the moment is what’s changed, but the details can become important when disaster strikes and you need to find the root cause. In those use cases, both local storage and remote (or Cloud) storage can work together.

Building an IoT device on which data is critical? Reliance Edge may be just what you need.

More about IoT and Reliance Edge

RoySherrill | May 15, 2015 | IoT | Leave a comment

Reliance Edge – the Firsts

Datalight has just released an open source preview of Reliance Edge™: our new file system for decision-quality data at the edge of Internet of Things (IoT). Later this month we will release a version under a commercial license with full MISRA C:2012 compliance. I’m excited about all the firsts with Reliance Edge, some market firsts, and some Datalight firsts.

Reliance Edge is the first dual-licensed file system for MCUs. Reliance Edge is available under the GPL v2 license, enabling anyone to download it, evaluate, test and modify it for free. The comprehensive reference manual is available on the Datalight web site, also for free. For those that need the ability to keep their source code proprietary, Datalight will deliver a commercially licensed version later in Q2 2015. The commercially licensed package of Reliance Edge includes additional features including a full file system test suite and a utility to exchange data between a windows PC and a Reliance Edge removable media like SD or USB disk.

The reliability offered by atomic update for user file data for an MCU application is also a market first. This capability delivers the power fail-safe reliability demanded by Industrial Internet of Things devices. Atomicity means that multiple changes to user file occur all at once or never happen at all. This atomic update, called a Transaction Point, can be controllable by the application, enabling the application to make small changes to user data and then commit it, or make LOTS of changes and commit them all at once.

Reliance Edge deterministic file system operation is a market first that delivers predictable response time (given a predictable storage device). The designer can configure the system and calculate maximum IOPS required to accomplish a given read or write operation. Also for systems that demand a given response time they can determine the configuration that will deliver that response time. For the first time, real-time systems can deterministically perform file IO on MCU-based and other systems.

Reliance Edge extensive design assurance documents is a Datalight first. The Design Assurance Package will be available for teams requiring design artifacts for standards-based development. Included in the DAP are Marketing Requirements Document (MRD), Software Requirements Specification (SRS), and Software Design Document (SDD), Test Plan and Test logs. Lastly for MISRA C:2012 there is the MISRA Compliance Matrix.

The small size and modularity of Reliance Edge are a Datalight first. In its smallest configuration, called File System Essentials (FSE), can be as small as 12 KB of code and requires only 4 KB of RAM. This FSE configuration also presents a numbered file interface more traditionally found in safety critical style designs where all data is clearly pre-defined at system build time. The modular design also enables unneeded functionality to be left out of compile and build thereby eliminating unnecessary code. Reliance Edge can also be configured with a POSIX style interface and built with a minimal configuration of 18 KB code and 9 KB of data.

With the increase in important data at the Edge of the IoT, many designers will be needing their first file system. Datalight’s Reliance Edge™ can fill that niche admirably, under GPL v2 or proprietary license. For more information, contact Datalight today or visit our GitHub and try out the code for yourself.

Learn more about Reliance Edge

RoySherrill | May 4, 2015 | Datalight Products, File System, IoT | Leave a comment

Reliance Nitro Transaction Explorer

One of the key differentiators for Datalight’s Reliance Nitro file system is the runtime flexibility. Not only does this file system provide more reliability options than any other file system on the market, they can all be changed on the fly through a simple API. To demonstrate just how easy this was, we created an intern project to do just that.

We decided to use Android as the visual environment, running on top of the ever popular Linux RTOS. This would also allow us to use two standard benchmark tests to demonstrate performance differences. RL Benchmark delivers the time required to run a standard set of SQLite database queries. The SQLite portion of Androbench measures only database Insert, Update and Delete, giving the results in a number of “transactions per second”.

We chose these benchmarks rather than raw throughput demonstrations because the Android environment accesses nearly all storage through SQLite database calls. These calls, and the overhead they cause in file systems, are the main point of contention. They slow down the latency of the device and shorten the life of the eMMC media.

The video below shows the results of our demonstration on a Nexus tablet. One of the most interesting aspects of our demonstration is the transaction counter. This gives a visible measurement of the additional overhead required for reliability on Reliance Nitro, along with the impact of various transaction settings.

The reliability settings of ext4 are not runtime alterable and the impact of additional database fsync calls is not visible. Also hidden is the reduction of device lifetime, though that will be felt by the customer soon enough.

Our whitepaper covering configuration settings and device lifetime

Thom Denholm | April 20, 2015 | Android, Datalight Products, Extended Flash Life, Flash File System, Reliability | Leave a comment

Embedded World 2015

This is my fifth year at Embedded World, and the weather just keeps gettnig better. Perhaps the nice days in Nurnberg contributed to a slight decrease in traffic at the show. In the Logic booth, we had some great meetings with long time customers, and learned about their new projects. We also heard about reliability challenges in hardware, from SD cards to data storage reliability in very small systems. On the third day of the show, we went Beast Mode and handed out Skittles to the many students in attendance.


This year, we showed a demo comparing the Datalight software solution to the default Linux solution in an Android environment on the Freescale i.MX6 Sabre reference board. This demo allowed us the opportunity to discuss the overhead of file system operations and how reliability considerations can be customized for performance. We’ll have a video of our demonstration available soon, for those who missed the show this year.

The Internet of Things continues to dominate the show space, and I think it is making the transition from marketing buzzword to actual movement. Gareth Noyes of Wind River spoke of it in his day 3 keynote. In it he compared the open architecture of the internet to closed, software defined network solutions, and the latter is the only infrastructure robust enough for the Internet of Things. Another key point was that IoT is more important than just telemetry, and should best perform analysis and take action. One great quote from his talk is “The future is already here, it’s just unevenly distributed”.

EW2015_Keynote EW2015_Wind

Of course cars and cockpits continued to attract eyeballs to booths. When tied to the IoT (as Wind River’s city simulator was) they make sense. In other cases, they are just eye candy. The hit for me was Rutronic’s race couse and “Lap Times” board, ala Top Gear. Jeremy Clarkson was not seen, however.

EW2015_Car EW2015_TopGear

One of the eyeball grabbers was directly across from our booth, where the mad scientist of Prüfrex was mixing up cocktails of some sort. Many people went home from the show remembering this guy, but how many remember their innovations in digital ignition systems and small engine control units? Not many, I’ll bet.


Thom Denholm | March 4, 2015 | Android, Extended Flash Life, Performance | Leave a comment

CES 2015

In January I attended the International CES with 170,000 of my closest friends, about 25% of whom were from outside of the US. Together we attempted to visit 3500 exhibitors and listen to many, many keynotes, panels and speeches. It was a people, technology, and gadget filled few days. Many of the announcements were very exciting, but not real as many vendors showed or proposed futuristic (not available today) devices and features in the keynotes and booths. You had to ask to really know, if it’s available now, will be available later this year, or just a great idea that someday may be available.

CES2015 Banner


BK Yoon of Samsung delivered an industry pitch for the Internet of Things. He mentioned that IoT will be open, secure, personal and everywhere. By 2017, 90% of Samsung products will be IoT, with 100% by 2020.

Mark Fields of Ford took a look at the challenges of mobility to mankind. He focused not on direct population, but on population density – of the top 100 densest cities worldwide, only one is in the US (Los Angeles, 90th on the list). Solutions ranged from parking to new methods for moving people in highly dense areas.

CES2015 Keynote

The Intel Keynote, by Brian Kranich, was a product pitch for Intel Real-Sense 3-D software. It will enable computers to See and be much more 3D aware, with gestures, being able to measure distance with a picture and other things. Bryan also announced a new small IoT computer from Intel is the Curie, a next Generation Edison that is the size of a shirt button.

The Mercedes Benz Keynote was delivered by Gary Shaprio, CEA president, who arrived on stage in a driverless concept car. The passengers sit in swivel char’s that enable them to face each other and not on the road. The walls of this concept car are computer screens that you can view your email or a show on. Very interesting, but as brought out in the Keynote, seeing driverless cars is now less about technology and more about the laws to allow them.

CES2015 Multi dronesThere was a specific area for drones in the main hall. There were so many it was bit overwhelming. Drones were big, small, had special controllers or cell phone controllers, consumer and industrial (costing up to $ 2,000). Many drones include their own camera or allow a camera as an add-on. Some were smart drones that attempt to come back to where they took off if you take them out of range (say send them out over 1500 feet).

CES2015 Drone cage

There were many screened off areas where the exhibitors showed their products. Some even had coordinated multi-drone flying in formation.



The wearable guys showed up in big numbers. From Fitbit to Jawbone, to Misfit, to not just for us, but also for our dogs and golf clubs. Wearables are also becoming a fashion statement with a Misfit activity tracker from Swarovski targeted at those who want some glitz. CES2015 Swarovski

CES2015 FitBark
CES2015 Golf

Much of the car talk moved from Telematics as in years past, to driverless and driver assisted cars.Hyundai had a movie in their booth that showed MANY drive assisted scenarios, from automatic parking to the car automatically detecting when a driver falls asleep and pulling over and stopping the car. When I asked a booth person about software/firmware updates for the car, he mentioned that they did not want the user to have to perform software updates so they will be done at the dealer at a twice a year frequency. Knowing what I know about software development, this seems like not frequent enough for me!

CES2015 Car

Toyota was promoting the Hydrogen powered car. This is essentially an electric car that converts the hydrogen to electricity. . It can be filled up quickly, as opposed to a Tesla that requires a couple of hours to recharge.

Android Auto (which shows as coming soon on the web site) was visible at CES, from Hyundai Pioneer, and others. It provides Googles Auto interface.

Apple Car Play was also visible at CES. Several vendors were showing support for it. Apple Car Play is largely and extension of the Apple iPhone screen to the car in-dash screen, speakers and microphone.It does take a physical wire hook up rather than blue tooth or other wireless connection.

CES2015 Eureka Park

Eureka Park was pitched by Gary Shaprio as the innovation center of CES. That’s where you found startups and crazy technology.

One of the most interesting innovations to me at Eureka Park was a cell phone jammer for drivers, which enabled anyone else in the car to use their cell phones but not the driver. A police captain had contacted the company for a cell phone jammer that works in crosswalks to reduce accidents for pedestrians who are focusing on their phones and NOT watching traffic.

Vocal Zoom from Israel, makes a voice recognition systems that uses lasers to detect sound coming from the skin on your face. An OEM product that they were just introducing at CES.

The fun-est booth was the Gibson Guitar booth. They had an open bar and live music and MANY guitars. Very awesome!

CES2015 Game of Guitars CES2015 Gibson Party

I’ve never thought of how Selfies drive our culture, but given that even our President poses for Selfies with other world leaders they sure must be. CES had multiple products to improve your selfie. Products from selfie stick to hold your cell phone away from you to a remote controlled camera that can be connected to your phone via Bluetooth.

CES2015 Selfie Stick CES2015 Selfy Booth

RoySherrill | January 21, 2015 | Consumer Other | Leave a comment

Mars Rover Flash Challenges

The Mars Opportunity Rover was in the news again this week, as NASA mission engineers try to overcome what they refer to as an increasingly troubling bout of rover “amnesia”.

In September of 2014, the team reformatted the flash memory. This algorithm tested each of the cells within the 8 banks for flash, marking any additional bad cells and recalculating the new drive size. After the procedure, the new drive was reduced in capacity by 1.7 megabytes and overall flash problems with greatly reduced for a time. The original design used 128 MB of DRAM, 256 MB of flash memory (in radiation-hardened card form), and another 3 MB of EEPROM.

The root cause is still under investigation. Possibilities include an intermittently bad spot in memory that isn’t read frequently, a structure which is not subject to wear leveling (explaining the improvement after the first reformat), or even just a timing issue – the memory takes longer to complete writes as it ages. One outcome of this investigation was a shift to a working mode that avoids the use of the flash data-storage system.

Embedded designers using NAND flash today also have to contend with the situation the media has too many bad blocks. With good wear leveling algorithms, the blocks that aren’t bad are likely close to the suggested erase count limit, so a reformat wouldn’t buy much time. Using DRAM instead of NAND flash is a bit extreme, but similar techniques are used today to reduce write amplification – such as caching data in memory until an entire NAND erase block can be written at once.

After another Opportunity reformat in early December, performance of the flash media remained intermittent. Repeated failures to write the flash caused watchdog software to reboot the rover, leading to a loss of communication over Christmas. Investigation is now centered on bank 7 of the flash memory, which seems to have the most failures.

I think it’s awesome that a device with an original planned mission time of 90 days on Mars is approaching sol 3900. Here’s hoping that your 2015 embedded designs keep going well beyond their expected lifetime!

Learn More about Wear Leveling

Thom Denholm | January 2, 2015 | Extended Flash Life, Flash Memory, Military/Aerospace | Leave a comment

Securing Data on NAND Flash Media

In an interesting article on security from Warren Kurisu titled Securing Data on Connected Embedded Devices, he discusses three situations where embedded devices need to protect data – when at rest, when in use, and when in transit. Datalight software can help protect the “data in use” case, including addressing an often overlooked vulnerability.

NAND flash media has become the standard storage media for embedded devices, either as raw flash chips, contained in devices such as eMMC and SD cards or as part of an SOC. In order to modify data on any NAND flash media, a copy is first made in memory, then modified and stored to a new NAND block. At this point, there are two copies of the secure data on the device – to ensure data security the original copy must be securely erased.

On eMMC media, the firmware provides secure operations that can be used to remove those blocks. We have discussed these operations before on our blog. Datalight’s Reliance Nitro is still the only file system that utilizes these secure operations on eMMC media. Another alternative is the Sanitize command, which securely erases any pending deleted blocks, whether or not they contain secure data. (Questions have arisen about the performance impact of that approach. Stay tuned for a report on an analysis of this aspect that Datalight is working on.)

Can the same thing be done on raw flash media? Absolutely!

Datalight’s FlashFX Tera has an API to request a compaction, which is an operation used to erase pending blocks. This is very similar to the eMMC firmware Sanitize operation. We are also considering adding the more direct operations of secure trim and secure delete to FlashFX Tera.

Reliance Nitro also provides features that help address the “data at rest” situations mentioned in Warren’s article. A full set of OEM attributes are supported and stored in the common disk format, available for any RTOS utilized by our customers. These attributes can be used to isolate data between users and groups on the same device or over any connections this device participates in. And of course, our customers can (and many have) plug in their own encryption module using Reliance Nitro APIs designed for this purpose.

Does your design rely on the ability to secure – and securely erase – data?

Learn more about the Reliance Nitro file system

Thom Denholm | December 17, 2014 | Datalight Products, Flash Industry Info, Security | Leave a comment

ARM Tech Con 2014

Arm TechCon logo

This conference was all about ARM, from a history of ARM (nearly 30 years, starting with the Acorn and Newton) through the newest systems challenges to Safety and Security. The mbed OS looks interesting – developed by ARM, this RTOS has power management, many different connectivity stacks and other components.

The Internet of Things was of course a major topic, and we enjoyed hearing about all the storage needed at the edge of the network. From data analytics to logging and cloud interface, it looks like MCUs will need a reliable file system for the best solution. Also interesting was the plan for MCU firmware updates in the field – they plan to provide a Flash area big enough for 2 copies of the application and a bootloader. Only one copy is updated, and the bootloader identifies the newest valid application and executes it.

There was a definite focus on energy use and efficiency. Some of the incredibly low-power (or low current) applications described were an ARM solar powered micro server. These harsh environment capable devices will be key in the third world. Especially fascinating was Jack Ganssle’s session on Ultra-Low Power design and debunking the 20 year life claim of coin cell devices.

RoySherrill | October 16, 2014 | Flash Industry Info, RTOS | Leave a comment

Making FAT reliable

Datalight developers know the danger of power interruption on embedded devices, and we also know the FAT file system well. In my 10 years as a software engineer on ROM-DOS, the internals of our FAT implementation were of daily interest. Recently, I put this knowledge to use in exploring how other developers have tried to make the legacy FAT file system more reliable while remaining exchangeable.

These operations are designed to improve the reliability of FAT media, and are somewhat successful in preventing the complete corruption of the file system data structures, but are rarely effective in protecting the user data. Some solutions can go further and, similar to Linux, can journal the user data, but these mechanisms greatly reduce performance, which is a cost too high to bear for most embedded designs.

Read more about making FAT reliable

Thom Denholm | October 14, 2014 | Reliability | Leave a comment

Designer of Things (DOT)

I just returned from the inaugural Designer of Things (DoT, like IoT) conference and it was an awesome start for a new conference focused on this key vertical market. There were two primary tracks: wearables and 3D printing. The sessions spanned the gamut from technology to make fashion, to how to build wearable devices that function 24×7. One of the key reasons I attend shows like this is to interact with a diversity of folks in our industry and after a slow start to the day (first session I was in only had 13 people in it) things picked up and by the time of the first keynote the audience had expanded to over 700.

A recurring theme for the conference was “Moving from Smart Devices to Wise Devices”, first mentioned by Gadi Amit of New Deal Designs in his Keynote on Tuesday — a great discussion of the power of the design of a new device. The focus was not on the hardware, nor on the software, but on the customer and the emotional connection with the new device from a holistic perspective. Giving the customer the best experience is the goal.

Designer of Things backdrop.jpgAnother theme was the maturing of devices as time goes on. The desire to upgrade the device and extend the functionality over time is a growing key expectation by customers. The best example, which came up often in the DoT conference, is the Tesla. Initially shipped without full functionality, the Tesla has an always on cellular connection so that software updates can be delivered seamlessly and improvements can be made often. Since initial production more than 500 updates have been delivered.

What became clear over the course of the week was that data is key, for both initial design and for continued evolution of the products. Data for design comes from potential customers and enables designers to better understand customers, their usage patterns, expectations, and preferences. Designers can perform A/B testing to identify the best feature mix, best interfaces and best interactions with customers. Data from the products informs future designs, shows what expectations were universal and which were not fully understood and which are the actual key features.

The inaugural DoT conference was a great first step. No doubt UBM will grow and enhance this conference and it will be even better next year.

RoySherrill | September 30, 2014 | Customer Industries, Flash Industry Info | Leave a comment