Julia Elvidge, Chipworks president, presented on the topic of Smartphone Patent Wars at the LES International Conference that took place April 7-10 in Rio de Janeiro. Julia spoke about trends in the mobile device market, how the mobile device market is driving growth in semiconductor and electronics, and how mobile data will drive the cloud market.

In taking an excerpt from this presentation, we look at an ecosystem called SIGMA to illustrate the convergence and state of the patent battles. SIGMA stands for:

  • Samsung: Traditional electronics manufacturer
  • Intel: Traditional chip manufacturer
  • Google: Traditional web service provider
  • Microsoft: Traditional packaged software manufacturer
  • Apple: Traditional PC manufacturer

Comparing this ecosystem in 2007, we saw companies that complemented each other with products and services, when compared to today where the picture is one of competition. Or perhaps “co-opetition” – which has been shown to breed licensing battles. (click the images below to enlarge).

But, of course, the story doesn’t end there. Similar charts can be made for not only the companies but for entire industries that were once distinct. When you include telecom infrastructure, peripherals, gaming, chips, device manufacturing, and cloud computing, you have an array of competitors with IP in their unique spaces but businesses that now overlap to compete for the same piece of the consumer pie. The breakneck pace at which this has occurred has resulted in orphaned/sold patent portfolios, new complex licensing battles where each player has little to lose in their core markets (due to lack of product and portfolio overlap) but everything to gain in licensing revenue, and of course, a rapid growth in NPEs targeting the big growth firms.

The rest of this presentation explores this concept further, reviews the current state of the smartphone patent wars, and offers some predictions on potential next hotbeds for patent litigation and patent wars, including cloud computing and remote healthcare.

Download the LESI 2013 Conference – Presentation on Smartphone Patent Wars

 

Posted in IP News | 1 Comment

Contributed by Ray Fontaine

The 6th annual Image Sensors conference was held in London, UK on March 19 to 21. Having attended in 2010, it was nice to return this year and find an ever increasing scope of technical content and diversity of attendees. The best aspect of the conference is the variety of end-use applications covered including automotive, broadcast and cinema video, consumer, machine-vision, medical, etc. It is a good reminder that imaging technology is involved in nearly every aspect of our lives. Unfortunately, like many technical conferences the Image Sensor 2013 Conference (ironically) doesn’t allow pictures to be taken. Therefore, articles like these lack a certain multimedia panache.

Highlights from the oral presentations included research in the area of single-photon avalanche diode (SPAD) arrays and time-of-flight (ToF) imaging systems. Advanced driver assistance systems (ADAS) are emerging as a reality and will continue to be developed as regulatory bodies worldwide push for safer cars. The practical use of ToF systems in consumer electronics was debated, although a new product from STMicroelectronics offers reflectivity independent short range distance measurement and could potentially disrupt the current IR-based proximity detector market for smartphones. Multi-aperture imaging has a lot of positive attributes, including improved low light sensitivity and high dynamic range (HDR) performance, depth mapping, and potential for thinner camera modules. These offerings come with the expense of greater computational requirements and increased camera module footprint. Two memorable (and entertaining!) keynotes on video systems and color reproduction included good reminders of the nature of the human vision system and human perception.

Rather than attempt to regurgitate all of the papers and presentations here, I’ll focus on two papers that should be of interest to our teardown and technology blog readership (who tend to gravitate towards small pixel mobile and digital camera applications). First up on Wednesday was Howard Rhodes from OmniVision who started with a review of OmniVision’s small pixel mobile device roadmap. New for 2013 is a move to TSMC 55 nm technology for third generation OmniBSI with a 1.1 µm pixel size. It is worth noting that while OmniVision reported advanced design rules for OmniBSI-2 in the pixel array only, third generation OmniBSI (presumably with OmniBSI-3 branding) will get sub-65 nm  generation design rules for the pixel array and logic region. Looking forward to 2014, Howard and his team are developing fourth generation OmniBSI to deliver sub-micron pixels (SMP) fabricated using 45 nm design rules. Beyond that, Howard is bullish on continued pixel shrink and notes that, while a lot of advanced technologies are up and running in R&D labs, it is ultimately pull from end clients that dictates when devices hit the streets.

As OmniVision marches down the small pixel roadmap, it always has its 1.75 µm pixel generation as a reference for each new platform. Third generation OmniBSI technology deployed in a 1.75 µm pixel shows continued improvements in sensitivity and reduction of crosstalk. So how do they do it? The domain of materials science offers a few knobs to turn and OmniVision has been working on optimizing its color filter and on-chip microlens technology. Chiefly among these innovations is the transition from Bayer patterned RGB to a proprietary Clear Process Technology. While there is no standard for RGBC patterning, OmniVision has chosen to use 1/2 clear, 1/4 green, 1/8 red, and 1/8 blue. Coupled with a custom image signal processor dubbed the L6, the prototype RGBC sensor delivers a 2x sensitivity improvement (as compared to Bayer RGB), and a 6 dB improvement in SNR in low light (<10 lux). The total system solution also shows improved high dynamic range (HDR) video performance. Adding in clear pixels represents a win for low light performance with a cost of minor color aliasing (for everyone, not just OmniVision).  OmniVision is continuously improving its system, and really, it will be the OEMs that will decide what they want.

I wouldn’t want to minimize the engineering and manufacturing challenges facing the small pixel guys, but it appears there are no fundamental barriers to innovation for the next little while. It’s not hard to predict that the small pixel mobile crowd is excited about stacked CIS and RGBC technologies to enable near term performance improvements. I suspect we’ll be hearing more details and performance metrics from Howard in June at this year’s International Image Sensors Workshop.

The second presentation I wanted to mention was given by Junichi Nakamura of Aptina Japan. While conventional digital compact cameras have been losing market share to smartphone cameras, it was mentioned elsewhere at the conference that there still is a market there and hopefully sensor and camera improvements can rejuvenate sales. On a personal note, I agree with this thinking. I intentionally travelled to London with only my Samsung Galaxy S III smartphone, leaving behind a bulky Nikon DSLR.  While relatively impressed by the performance of my smartphone camera, the release of bridge cameras and compact mirrorless interchangeable lens cameras (MILCs) make sense as gap fillers. Regardless of whether it is a growth or declining market, it is not controversial to say there is strong demand for high frame rate video capability in this space.

Nakamura san gave a nice overview of high frame rate imaging in DSCs. The development of the AR1011HS represented a balance between sensor resolution and full resolution video frame rate. The resulting 1 inch format sensor features 3.4 µm generation pixels, a 10.8 Mp resolution, and full resolution video frame rate of 80 fps. Aptina suggests that at 80 fps, there is almost no issue with the electronic rolling shutter effect, enabling cameras without mechanical shutters if desired. The sensor uses a 13 bit column parallel successive approximation ADC (SA-ADC). This Aptina sensor uses the dual conversion gain (DCG) mode pixels branded as DR-Pix. Nakamura san showed a table comparing the new DCG sensor to previously published metrics from other Aptina sensors. In low conversion gain mode, the AR1011HS has a full well capacity (FWC) of 25 ke-, and in high conversion gain mode it has a FWC of 9.1 ke-. In high conversion gain mode, the noise floor is 1.6 e-. Nakamura san gave performance comparisons to other recently published work and indicated more results will be presented at IISW 2013.

There truly are several memorable moments from IS2013, and I regret not drawing attention to the other presentations. They were of high quality, but I’m sure the conference organizers would prefer you attend next year or purchase a copy of the proceedings!

 

Posted in CMOS Image Sensors, General News | 1 Comment

Contributed by Ray Fontaine, Image Sensor Analyst

Within our group of pixel analysts, we most often spend our days immersed in the business of analyzing the device structures and circuits of image sensors. We are, however, also in a unique position to comment on the image sensor market. Our procurement and teardown groups routinely purchase the latest and greatest electronic gadgets to track the trends in systems architecture and component design wins. Some of these convert to the full teardown articles we routinely publish, however, behind the scenes, quite a lot more data is flowing in to our internal databases.

We procured and cataloged the image sensors from over 80 leading mobile phones and tablets in 2012. A word about the methodology used for this analysis: the intent here is not to provide a comprehensive market share or revenue tracking summary. We do routinely go through those exercises, but the focus is on a first-level mining of our devices database in order to comment on what we are seeing in real products. A company’s product strategy certainly weighs in to the interpretation; consider Apple as an example. Apple famously keeps its mobile product portfolio confined to a few gadgets per year, so naturally there are fewer events per year to monitor. This analysis also does not directly reflect the volume of those sales. Motorola released considerably more products, yet had a comparatively lower share of the smartphone market.

Our mobile phone and tablet procurement roadmap essentially corresponds to the intersection of high volume, value, and technological innovation; however, it does also include coverage of events that might be triggered by a specific client need. It is reasonable to conclude that we are covering the truly important events (or one could argue the only events that matter – leading smartphones), but caution should be exercised when analyzing the aggregate data. Enough with the disclaimers – on with the data!

Image Sensor Design Wins from 2012 - Image 1

Chipworks' 2012 Mobile Phone and Tablet Teardowns (by manufacturer)

 

Of the mobile phones and tablets we tore down in 2012, most contained two camera modules. Focusing on the primary camera modules, the resolution trend we are seeing is a dominance of 5 Mp and 8 Mp sensors. A notable outlier is the 41 Mp image sensor from the Nokia 808.

ISDesign-win-2

2012 Mobile Phone and Tablet Primary Camera Resolution

Despite the release of several 1.1 µm pixel size devices to the market in 2012, they are only just beginning to find their way to downstream devices. We are seeing more of them already in 2013 (not shown in this data), but the penetration rate of 1.4 µm pixel devices will likely remain fairly high over the course of 2013. Of note, and not explicitly analyzed here, is the resilience of front illuminated sensors. All of OmniVision’s devices are back illuminated, while all of Aptina’s and Toshiba’s are front illuminated. Sony and Samsung had a mix of front and back illuminated devices winning primary camera sockets (although the majority of sensors from both companies are back illuminated).

ISDesign-win-3

2012 Mobile Phone and Tablet Primary Camera Pixel Size

The important question is, “Who is winning the primary camera sockets of the most desirable tablets and smartphones?” This application space appears to be trending towards a commodity market. At best, it seems to be a four or five horse race between OmniVision, Sony, Aptina, Samsung, and Toshiba.

ISDesign-win-4

2012 Mobile Phone and Tablet - Primary Camera Module Image Sensor Design Wins (by vendor)

It is useful to analyze the real data from 2012 as it is complementary to the estimates provided by several sources. What it doesn’t show, though, is momentum. Sony’s stacked CIS die, already in mass production, will put pressure on others to innovate. Toshiba has publicly committed to increasing its market share in the mobile space, and Aptina is pushing its back illuminated devices into mass-production this year. What effect will this have on the market? Keep watching our teardown and technology blog as we’ll be commenting on this over the course of 2013!

 

Posted in CMOS Image Sensors, Design Wins | 2 Comments

This Technology Blog will be live updated to include some cross sectional and polysilicon shots of the Apple A5. If you are seeing this message then check back regularly or follow us on Twitter @chipworks to get up to the minute updates.

Apple TV is a curious beast.  It is undeniably a good product, but one that is treated almost like an accessory, or even an appliance, by Apple. New iterations come out with no fanfare and software features are held consistent across older and newer variants.  The people paying the closest attention are those who are interested in cracking the device (which has eluded the hacker market since the Apple TV 2 days)…and, of course, us.

apple tv with new A5 i2  apple tv with new A5

Despite the lack of commercial attention, there has been much ballyhoo out there with the latest version to hit the store shelves with the part number MD199C/A.  Again, mostly indistinguishable from the prior version, except this time with a brand new A5 processor with the part number APL7498.  And again all the questions about who is the foundry, what are the differences, what is Apple up to this time around.

First up a look inside the “downstream part” because Apple has made a few notable changes in this ATV version we tore down.

What is unusual is that the device does not use the package-on-package configuration for the DRAM/App-Processor that we have come to expect for the A5 (and not the A5x). So does this mean it is some kind of A5X or a hotter running chip or is this just a lower cost way for them to manufacture the device?

The wireless module supplier for the ATV continues to be USI (versus Murata for the phones) with the part number 339S0203. The board shows a nice antenna path for those interested.  Based on specifications, inside the core functionality is provided by the Broadcom BCM4334.

Notable by its absence is the lack of an Apple branded audio chip (by Cirrus Logic).  Apple may be following a trend we have seen with other applications processors by including this functionality on the die. Once the polysilicon photo is available we’ll be able to look closer.

Correction – as has been pointed out by our readers, there was no discrete audio codec in earlier generations of the Apple TV, by Cirrus or anyone else – our bad for getting confused in all these Apple teardowns!

Apple MD199CA Teardown Board side 1  Apple MD199CA Teardown Board side 2

Other notable chips cataloged (so far):

  • SMSC LAN8742 Ethernet Controller
  • Hynix H2JTCG8T22MBR  NAND Flash
  • Elpida B4432BABH DRAM
  • Apple 338S1127 Power Management Chip, likely another of the girls from Dialog Semi
  • Texas Instruments 54218 PMIC

Let us now look closer at the Apple A5 itself

Is this new A5 a pipe-cleaner for TSMC in a lower volume (and risk) device? Is this new A5 a lower cost variant that we will see in new lower end phones from Apple? Is it a shrink from Samsung’s 32-nm process to their 28-nm? All were speculated upon, and this time around we can deny the first rumor by confirming that the chip has die markings consistent with the continued use of Samsung as the foundry partner.  With respect to the second rumor, we can provide our $.02 that we do expect to see this chip in future Apple devices (such as a possible phone or iPod) because that behavior would be consistent with what they have done in the past. As for the die shrink, the math tells us that the size reduction is more than a simple shrink – some functionality has changed too. We’ll have to wait for the cross-section to see if it is  fabbed on the smaller process. (Update – see below.)

The new device measures 6.1 x 6.2 mm when compared to the prior generation A5 measuring 37.8 mm2 down from the prior 32-nm variant at 69 mm2.

APL7498 Die Photo

Die size comparison using the polysilicon from the prior gen A5 (left) with the top metal from the current gen A5

Now we have the cross-section, we can say from the transistor spacing that it is still Samsung’s 32-nm process – no shrink here, definitely a new design.

Cross-sectional image of transistors in the new Apple TV A5 chip

Update – here is our first guess at the functionality using our die photo of the new A5 chip de-layered to the transistor level.

Apple's new A5 (APL7498) chip de-layered to show block layout

If we compare this with the earlier 32-nm APL2498 part, it looks as though we now have a single-core ARM A9 CPU, together with a dual-core GPU as in the APL2498. The Apple TV has always been 1-core, but the APL2498 had one core disabled – maybe Apple now thinks that sales will be enough to justify a dedicated part, or maybe we are going to see another single-core device in a different product line.

To get the almost 50% die size reduction that we have, though, there has to be more than removal of one core – other changes have been made. As yet we haven’t quantified them.

We’ve also looked at more of our cross-sectional pictures, and we now think that this part uses a mixed-signal version of the 32-nm process that allows extra passive components such as resistors, capacitors, and inductors, that is much more suited to analog circuitry. So it is possible that the analog sections have been re-designed, always a work in progress when we get this small, since analog circuitry does not shrink anywhere near as predictably as digital.

We’ll keep you posted if and when we find out more!

Posted in Advanced CMOS Technology, App's processors, Design Wins, General News | 13 Comments