Author Archives: kevinrenatojones

My thoughts on how productivity is way more portable than in the past, but how annoyingly some non-visual features only appear on products with larger screens

Posted on December 13, 2019

Johan Sebastian Bach probably wished he’d had a better way to work on his “Musikalisches Opfer”, “A Musical Offering” when he traveled back home to Leipzig from visiting King Frederick the great of Prussia  near Berlin in 1747. Ok, he probably instead really wished for something faster and more comfortable than a horse-drawn carriage.

I still remember being in high school, when I had a 30 minute ride between school and home, each way; wanting a portable typewriter that ran on batteries; all the homework I could have done.

In 1987, Deane Blazie and his company, Blazie Engineering, came out with the Braille ’n Speak, very awesome for its time. David Holladay told me there was nothing like it in the sighted world at that time. He considered buying one for his own use, even though he is sighted.

The original version was a braille note taker, had 192K of memory that could be separated into 30 separate files. It was kind of that portable typewriter I wanted; it had  actually already been out when I was a senior in high school, I just didn’t know about it until a month before   I started college.. The Braille ‘n Speak was 8 by 4 by 1/2 inches and was way easier to carry around than the Perkins braille writer which I still used in my dorm room, just not loudly in my classes.

People everywhere got excited when laptops became viable, affordable, and light weight enough to not break the average back, though the most portable models even today are still definitely breaking wallets. Even the lightest of laptops back then still had rather large footprints, until the netbooks came out in the late early two thousands. People liked netbooks because they were easy to carry, and although not very powerful were good for writing projects and web browsing.

Back in the blind community, Levelstar came out with both the Icon, and the Braille Plus, which were kind of the Braille ‘n Speaks of their time in 2007. The Icon was 3 by 5 by 1 inches, the Braille Plus slightly wider. They both ran linux,, excited many people, and probably would have gone much farther if it weren’t for the industry-wide disruptive changes brought by Apple and their iOS devices. Yes, they also killed the netbook market.

When the first iPads came out, people thought they were just personal screens to consume content on; but now, ten years later, as iPads continue to get more powerful, many people see with significant success, how much work they can do on them while on the run; just ask  Federico Viticci. You can even get very nice iPad cases with keyboards built-in so that they in some ways almost function like laptops, though probably a netbook would be more accurate. The problem is, most people are photon dependent, and they can’t seem to get anything done without a large flashy screen to look at.

I often hear people talk about how much they can get done with their iPads, and that’s great, but my annoyance is that this means the majority also think that the iPhone is useless as a productivity tool. This means: I can’t press command-tab to move between open apps on my iPhone, or get a list of keyboard shortcuts offered by an iOS app. Even though both of these are completely available using the exact same Bluetooth keyboard on  iPads. I can’t think of any technical reason why the same keyboard-focused productivity features used on iPads every day can’t also work on iPhones.

Since 2010 I still carry a foldable Bluetooth keyboard along with my iPhone, and since 2014 braille screen input, more often called BSI has also been available. This means that blind users have been able to be just as productive as their sighted counterparts with their larger iPad screens. If I were in college writing papers today, I could probably do 95% of them on my iPhone only needing my MacBook for finishing touches. If I were sighted, I’d probably want larger screens too, but I hopefully would still appreciate that small screens can also be just as effective.

It seems that many products only offer their high-end features on their larger screened devices. This can be interpreted by some as kind of a screen tax. “I, who can’t use a screen am forced to pay more money for a larger screen that I can’t benefit from, just to get a quad core CPU instead of two cores, etc.” “We only make phones with huge screens and no home button, because that’s what everyone wants.”  When individuals or companies come up with some new awesome product, I just wish they would not assume that everyone thinks the same ways they do.

I still smile when I remember how my friend Eric Knapp explained how confused people looked when they saw me typing on my keyboard but couldn’t see any screen or device; my iPhone was under the table attached to my belt. I wear bone conduction headphones in public, so VoiceOver speaks to me through them just fine. If the iPhone got those cool keyboard shortcuts on the iPad already mentioned above, I would consider that a nice step towards improvements.

There is a very cool app for both iOS and Android called Voice Dream Reader, it can read all kinds of file formats, and to some degree, makes digital text into a kind of audio book. I use it every day. I also thought how amazing it would be if I could have Voice Dream Reader on my Apple watch, the smallest e-book reader ever. Alas, the Apple watch can only play audio through Bluetooth headphones and speakers. Yes, I totally get how bad music would sound through the watch’s very small speaker, but for reading a book; especially if I’m just laying in bed, it seems like another opportunity to think outside the box not taken. Voice Dream Reader is on my watch now, but requiring a Bluetooth audio device makes it inconvenient for me to use.

If I were complaining just to complain, I could have succeeded by babbling to myself in an echo chamber. I wrote this to hopefully show mobile productivity from a different angle, hoping a reader or two might take the next opportunity they have to think or better yet just step outside the box and include more users, regardless of what screen preferences they might have.

My journey to the cool Amazon “Show and Tell” feature discovering along the way that the Echos Show 5 and 8 won’t ever be able to support it.

Posted Tuesday, December 3, 2019
One of the bigger challenges for a blind person is quickly identifying things that aren’t physically unique or labeled in braille. This is one of the frustrations technology has helped in a big way.

The first device that made a significant breakthrough in this area, was the I.D. Mate. A talking barcode reader with a built-in database of products. It was very cool, very efficient and also very expensive; still costs $1299 today. I considered buying one in the fall of 2007, but now am happy I didn’t.

I did however, in late 2009, buy a $300 USB barcode reader and attach it to a netbook which I already owned and had been using. Still expensive, but way less than the I.d. Mate. It also meant I had to keep the netbook on top of the microwave and plugged in. It did work though, was faster than more modern solutions still today, but it was also cumbersome and I finally gave up on it.

There are several nice apps, like Seeing AI,  for either or both iOS and Android that can identify barcodes today. The problem is the APIs assume that the barcode can be visually aligned in the camera view. The app developers have offered beeps to help the blind user do this, but it’s still not as efficient as a dedicated scanner. Smartphones are way more mobile than my old USB barcode scanner attached to my netbook though, so it’s still somewhat of an improvement.

The only annoyance for me in using a smartphone is placing round containers on the counter and then them rolling around; even holding them with one hand, I wished that I could have both hands free to position the item I was identifying.

Enter the Echo Show from Amazon. When the first generation Echo Show was announced with it’s flashy screen so you could watch videos in the kitchen I thought that was the most useless thing ever for a blind person; but then Amazon announced the “Show and Tell” feature in their September 2019 release. I was interested, and decided to go for it.

The Echo Show 5, their most recently announced version seemed the best for me. It was small and cheap, too cheap. I got it and then found it didn’t support Show and Tell. Amazon still says the feature is supported by Echo Show, first and second generation. The Echo Show 5 doesn’t have generation anywhere in its name, but I figure it’s new why wouldn’t it support show and tell. I then found it can’t, because its camera is only 1 mega pixel; I’m still wondering why anyone would want a camera that anemic. Pretty bad if i, totally blind knows 1 megapixel is that bad.

The problem is though, that it really  is that bad, it means that a blind person, who doesn’t need a screen at all can’t buy the least expensive visual models, grumble. This also excludes the new Echo Show 8, still only 1 megapixel camera, frown. The Echo Show  first generation is the best way to go. It’s around $100 for as long as it’s still available, the second generation is $230. More than twice the price, with very little benefit if you can’t see it.

It’s been setup in my kitchen for almost two months now, on top of the microwave, but still smaller than my old netbook. I find identifying food faster and do find having both hands to hold items as convenient as I had imagined. Its database is somewhat limited, but still not bad. I’m guessing it will grow over time. Some times if it can’t identify something exactly, it will read some of the text it can see which can be just as successful in my opinion.

turning on VoiceView, Amazon’s screen reader is easy, and adds some nice capabilities to the Show, and VoiceView gestures are very similar to those in VoiceOver on Apple’s iOS. The Echo Show, first generation, is definitely worth it, even if you’re totally blind and can’t see the screen. The Show and tell feature is more convenient than scanning barcodes with a smartphone, and it will be able to use the “cook to scan” technology if you ever decide to get the new Amazon smart oven in the future.

Yes, I later realized I could put the phone on the counter face down, and then have both hands to position items to be identified, but am still glad I got the Echo Show. It is always ready to identify things for me, even if my phone is in another room, or doing something else.

My thoughts about unlike a picture, an audio recording needs to last a longer amount of time to develop

Posted on October 19, 2019
Audio takes time.
Many have said, “a picture is worth a thousand words”, but it would take way longer to say or write those words than it did to take that picture. A picture is the capturing of a moment less than a second that lasts metaphorically forever. I imagine that someone could look at a picture over a period of time and realize more details they hadn’t before as time goes on, some of the strengths of a picture
Why am I, a totally blind guy writing about pictures? Because there is also an equivalence for people who can’t see them. I’m guessing many reading this post have pictures of their family and friends, or even of people they’ve just met; for me that’s recordings of those people in my life talking. This is where the similarities differ. Audio unlike a picture only lasts as long as it was originally. I can’t focus on a millisecond of the audio like someone can focus on someone’s face in a picture, and it’s something I think people aren’t realizing at first.

Some times when I ask someone to record, they just say a few words lasting less than 10 seconds, but I find that at least for me, it takes a minute or two before the person’s voice starts to resonate in my mind.
If you have a page of text you can take as long to read it as you want, but if that text were spoken to you faster than your brain could understand it, you would be overwhelmed. . If you only let cheese age for a day, you would probably only still have curdled milk. .

Music is also like this. It may be the only art form that actually exists in time, in the moment when it is heard; no matter when it may have originally been written. Also, if a slow song were sped up, its meaning would be lost and it’s essence destroyed.

Just some thoughts to consider.

How the Amazon Basics microwave oven has replaced the much more expensive talking microwaves made specifically for the blind

Posted on Friday September 6, 2019

In summer 1981 between my fifth and sixth grade years, my parents and I visited my oldest sister Kathi in Colorado. She had a microwave oven, and her kids who were in grade school could use it to cook or reheat foods. Kathy thought it would be good for me also, as it would be safer than a stove.
Later that summer Mom and Dad bought one.

Although not the panacea originally thought as, the microwave is still quite useful I use it almost every day. The model I’d been using from 2001-2018 was the Panasonic mid sized model, though I had to buy a second one after the first one died in 2014 but hey 12 years isn’t bad.
Still one problem for blind people with just about any microwave though, is that they have flat panels so if you’re blind it was hard to know where the buttons were. Many of us found ways to braille labels and put them on to the microwave panels. Braille takes up a lot of space though, so some of us also , used Highmarks, or fabric paint, which is much cheaper, to save space; but there was only so much room. This meant not all of the more advanced features or any features selected from a menu were usable unless memorized.
There were talking microwave ovens made specifically for blind people to use, but they were significantly more expensive, costing as much as $400,  and often hard to find. Some of them also didn’t have as many features or were lower powered.

Then last summer Amazon announced their Amazon Basics microwave oven, and you could control it with any of their Amazon Echo  devices.
I read reviews when they came out, but sadly many people thought it was silly or only a novelty. Why control something with your voice when the buttons are right there. They seemed not to think about how much more convenient it might be for someone with a disability, or even for someone without any disability at all. They also mentioned that the Amazon microwave was under powered, and it is at only 700 wats, and it is also smaller, so it may not serve a family of more than 2 people very well, but it’s a start. With that in mind I still felt it was an ok experiment.

It showed up, I plugged it in, and it configured itself. Because I had already configured an Amazon echo device, it knew my wifi network, and once on there, it also set the correct time. Awesome, now my sighted friends won’t have to tell me that the clock isn’t set anymore.
I still had a friend mark the microwave with fabric paint though, and one day when there was an internet outage I had to press the buttons like an animal. Most of the time though, , unless in a phone call, I control it with my voice.
One can say things like “Alexa, Cook microwave for 3 minutes” and it will do that, you can also say “at power x” where x is from 1 to 10. I also had marked the popcorn bacon defrost and reheat buttons on previous microwaves I’d owned, but this was about the most a blind person can do with most models.
With the Amazon model, you can say things as advanced as, “Alexa, Cook 8 ounces of broccoli,” “cook one cup, (or bowl), of soup;” “cook one cup of coffee. saying heat also works. baking a potato also works. There are more commands, I’ve only mentioned a few here.
One might say that’s cool and all, but the expensive talking microwaves specifically for the blind could tell you how much time was left in cooking. That’s true, but you can get the same on the Amazon microwave as well. You can also add more time while it’s cooking; so if you say “Alexa add 1 second to microwave,” it will tell you something like “cooking 45 seconds on power 10.”

It is true that the Amazon basics microwave is under powered, so it takes a bit longer to cook things, but at the end of the day, it’s really not that big of a deal. It is also quite small, large dishes may not fit. I still call my experiment a success with a few miner caveats.

General Electric also has a model of microwave for about $150 that can be controlled by an Amazon device. It is larger, 0.9 cubic feet,  and runs at up to 900 wats, so also not as under powered. It also has a feature where you can scan barcodes on frozen food packaging with your smartphone, after which your phone will look up cooking directions and send them to the microwave. This in the reviews I read seemed not to work so well, but hey probably future models will get better.

Even if one  bought the GE model and an Amazon Echo Dot   for around $200 , they could have a talking microwave for about half the price  than one of those previously mentioned talking models specifically for the blind. As I have said, mainstream device plus talking cell phone, or in this case Amazon echo device, equals talking, or accessible mainstream device. Seemingly novelty features to many are game changing accessibilities for others. Designing with inclusion from the start, is always the best way to go.

My thoughts and discoveries on how Amazon now uses proprietary AC adaptors on their echo dots.

Posted on January 7, 2019
A month or 2 ago, I read that the new Amazon Echo Dot third generation model no longer was powered from micro USB, but now required a proprietary AC adaptor, I remember the old days when every device had its own AC adaptor,  those were frustrating times. I then got my own Amazon Dot third Gen model, and was annoyed. Then, three weeks ago I read some tweets where others were also annoyed, and questioned why Amazon made that change. I then realized, hey I have an iDevices switch and it can measure energy, so I decided to do some testing and find out.
When  idling, the Dot 3rd Gen model draws about 1.8 watts. I then played Beethoven’s 5th symphony at full volume and could only nudge the Dot up to 3 watts, even in the moments marked fortissimo .  If someone could double that some how, so the Dot drew  6 Watts, or even triple it to , 9 watts, that would still  fit in the generally accepted ceiling of 15 Watts on micro USB 3.1. Yes, even the Amazon Echo Dot third generation can run on micro USB, so it is not a technical limitation.
My thoughts are that people tried to power their new Dots from USB ports on their computers or old USB hubs, where they only got the traditional USB specification of 5.0 volts at 500 milliamps which only multiplies out to 2.50 watts. I’m guessing Amazon got lots of nasty calls when people tried to play music and had problems. They decided instead of trying to tell people that the Dot required 1 amp or throwing in a USB power adaptor they just went proprietary.
Ye it’s still annoying, but I also still enjoyed figuring it out.

How to set up an iDevices switch as a blind person.

Posted on December 18, 2018

All over the internet you can find people write phrases like: “first world problems”. Here’s one probably most people haven’t heard before: “blind world problems”. E.g. problems sighted people will probably never experience.
Earlier this month, I setup my first iDevices switch, but until I knew what I was   doing, it was quite a challenge. I had bought it some time ago so I didn’t have the box anymore, so I  couldn’t get the number needed to set it up in the iDevices app from there. I looked all around on the device for the number using Seeing AI (except for the side with the plug that goes into the wall, didn’t think it would be there) and and gave up for the day. The next day, I got sighted help and was told it was on the side by the plug, that faces the wall, where I didn’t look. So blind readers, the 8 digit number you need for setting up iDevices is on the side of the switch facing the wall , in the space  closest to where you would plug in the thing you want to  control. .
Once I knew that, setting up the switch was very easy. Both Seeing AI and the iDevices app could see it, and the iDevices app is quite accessible.
There are 2 ways to get the number of your iDevice switch into the app during setup. You could paste or type it in to the edit box, but I just capture it with my iPhone’s camera, which, even as a blind person is very doable. When the app wants the number and displays the camera view:
1. Make sure you have good lighting, Even if you used the flash, which the iDevices app isn’t capable of, the number seems unreadable in low light.
2 place the iDevice switch on a flat surface with the plug that goes into the wall facing up.
3. hold the phone directly   above the switch  so the camera lens is positioned next to the plug that goes into the wall, towards   where you would plug in the thing to control.
4. Slowly raise the phone straight up about 1cm per second. You should hear that the number capture was successful within 5 seconds or so.
Beyond that, the setup was very easy and accessible.
People say a picture is worth a thousand words, so I needed almost that many to try and explain where the number was on the switch. Let me know if it made sense. 
One more thing,   I use the same camera technique mentioned above for capturing the number on the iDevices switch when I setup my Apple watch. It  works very well there also.

My beginning explorations about less visual alternatives to spreadsheets for screen reader users

Posted on December 12, 2018

Almost 2 weeks ago  I was listening to the Mac Power Users podcast with David Sparks and Katie Floyd, the episode had one of the best titles I’d ever seen,  “My Life Is a Subscription” this could be a blog rant all by itself, but what they wanted the listener to get out of that episode was how to be aware of and manage their subscriptions. Sadly for me, they used the sighted person’s go-to, the spreadsheet. If you can see spreadsheets are nice and visual, convenient, but not so much when using a screen reader. Especially if using Apple’s Numbers program, because there is no go to cell keyboard shortcut  command. Beyond that, even if there was one, like in Microsoft Excel it still leaves it up to the user to figure out which cell they want to navigate to.   I’d been frustrated before by how people love their spreadsheets, and even complained about this in a speech I gave at Madison UX 2014.  David and Katie reminded me of this frustration, so I  decided to explore if there were less visual   alternatives.
My friend Kyle Borah suggested databases, so I went there first.
The mac has sqlite installed by default, and sqlite can run on just about anything. The lite really only means that it doesn’t run on a server and doesn’t allow for concurrent users, but for an individual person, it can work very well. SQL  was originally called SEQL (structured English query language) so now we know why people say sequel today. SQL is easier to learn than many other programming languages and will probably be where I play and blog about in the future, but then I remembered I had a cool little app on both macOS and iOS called Soulver, and for this case, managing my subscriptions, Soulver was more than equal to the task.
Soulver is kind of like the Microsoft program called  notepad and a calculator, so you can write things in a sort of natural language and it will do the math for you. lines beginning with // are comments so you can write notes to yourself. I didn’t feel like putting my real subscriptions into a public blog though, so I made some up. Besides, that way I could show currency conversions.

//fictitious subscriptions

//say that 3 times fast

//subscription 1 renews on January 1

sub1Annual = 100 GBP in USD = 125.69 USD

sub1month = sub1Annual/12 = $10.47

//subscription 2 renews on the 10th of the month

sub2month = $5 = $5.00

//subscription 3 renews on the 21st of the month

sub3month = $2.99 = $2.99

sub1month + sub2month + sub3month = $18.46

 

Here’s what the developers of Soulver call “back of the envelope calculations”.

 

//my fictitious  day trip to Chicago

//oh wait, I actually did something almost like this back in 2015

//some of these prices are also  fictitious, though I tried to be somewhat accurate The bus roundtrip from Madison was $62 = $62.00

Tickets to the Shedd aquarium and 2 other museums cost $65 = $65.00

Transportation on the L cost $15 = $15.00

two  meals and a snack cost $30 = $30.00
//that Chicago pizza was worth it.

$172.00

 

In this last example I didn’t use variables, I just wrote how someone might write down notes on the fly. Most reviews I’ve seen unfortunately showoff Soulver with screenshots, but that would be disingenuous of me, so I exported my examples from Soulver into .txt files and then pasted them into this post. Soulver can export to html and PDF as well as text, which is great if you want to share calculations with others who don’t have it.

 

Soulver also has your ensemble of basic scientific functions, it can do quite a bit; so  let’s go further. Wisconsin can get pretty cold  in the winter, and I’ve actually heard some people wonder why heated air inside houses and buildings is so dry then, so here’s a bit of what you might learn in meteorology 101. Depending on the temperature, air can only hold so many grams of   moisture per cubic meter; The warmer the air, the more it can hold. This is usually told to us as relative humidity, but to the meteorologist what’s more important is the dew point. The dew point is the temperature at which the air is totally saturated, e.g. at 100% humidity. So your furnace sucks in a bunch of cold air from outside heats it up to 70 degrees F or 21.1 C and keeps your house warm; but without adding extra moisture to the air, it only has what it could hold when outside. Let’s use Soulver to figure out a real life example. As I write this the current temperature outside my window is 24 F the dew point is 19 F and the relative humidity is 79%Let’s see what the humidity is when that air gets  warmed up to a much more acceptable 70 degrees.
First let’s calculate with the original outside temperature of   24

 

//calculating relative humidity from air temperature and dew point

//b is a constant used for calculating vapor pressure is in degrees C

b = 237.7 = 237.7

//air temperature and dew point must be converted to Celsius

//with no interface to input data, here’s where we do it

atf = 24 = 24

dpf = 19 = 19

//temperature conversions

atc = (atf-32)/1.8 = -4.4444444444

dpc = (dpf-32)/1.8 = -7.2222222222

//calculating saturation vapor pressure svp,  and actual vapor pressureavp

svp = 6.11*10.0^(7.5*atc/(b+atc)) = 4.3967971796

avp = 6.11*10.0^(7.5*dpc/(b+dpc)) = 3.5564947151

//returning relative humidity

round(avp/svp*100) = 81

 

I know, it’s 2% off, this formula seems to lose a bit of accuracy when the temperatures go below 0 C.
Now’ with just changing the atf from 24 to 70 I get 14. Now we know. This also demonstrates one thing databases are not so good at that spreadsheets are, what-ifs. When I was talking about this last week with my friend Fintan, he said he uses what-ifs all the time in his spreadsheets at work,  and that was not so convenient with a database; Soulver can easily do what-ifs also, we just saw one above. I also realized something else cool about Soulver.Being a programmer as I am, instead of using Soulver for more advanced calculations like calculating relative humidity, I had already written a function to do it in a python math environment I put together 2 years ago, more blogs about that later. Soulver besides being notepad and being a basic spreadsheet at least in functionality, it can also fill in as a basic programmable calculator. You can’t do if-then, or loops but still a fair amount, more than a TI36 which can do just about anything numerical but has no programmability at all. Soulver could also be useful for someone who wants to figure  out some math but doesn’t  know any   actual programming language at all. As we have found, Soulver is quite useful.
The big down side though is it’s only on Apple devices, but there is a similar program called Calca that works on both Apple and  Microsoft Windows. It seems quite a bit more powerful even able to do some symbolic math including linear algebra, playing with that is probably one of my January projects. Calca’s downside I can see thus far though, is that   Soulver’s way of performing calculations is more convenient, closer to natural language,   and for that  still  keeps a place   in my tool box.