Renewed as an MVP for 14 years

July 1st came and went this year with a lot less uncertainty and dread. That’s because this year all MVPs were renewed for another year due to the lowered opportunities available during the pandemic. But even if I didn’t worry about it as much this year I was still just as excited to get the official notice that my MVP status has officially been re-awarded for the 14th year. I continue to feel honored and grateful for Microsoft’s recognition of my contributions to the community for another year.

But now its time to plan for the new year.  The Covid-19 pandemic shut down all in-person speaking events for almost 18 months  I have spoken at a couple virtual conferences last year, but I’m looking forward to in-person events starting up again later this summer. I’ll be traveling to Chicago to present at SPFest in a few weeks with two additional events later this fall.

Over the last year I’ve been spending a lot more time working with Power Apps and Power Automate, particularly as it applies to SharePoint and Teams.  In addition to being re-awarded as an MVP I continue as a Dual Super User in the Power Apps and Power Automate community forums. With the announcement last fall that SharePoint workflows are going away these two areas will become even more important for working with SharePoint online.

So here’s to another year as an MVP. I’m really looking forward to it.

Excel Date changes in Power Automate

Excel2flowSometime around January 15, 2021 a change was made to the List Rows action in the Excel Online (Business) connector that stopped bringing dates in as Serial dates and started bringing them in as ISO 8601 formatted strings.    If you have existing flows that were written prior to January 15th there is a good chance that this change will break your flow. This blog will explain the background behind Serial dates in Excel, explain what you can expect going forward for Excel fields formatted as dates, and provide some helpful formulas that will let you convert dates if necessary.

Edit: This change was due to a regression bug.  Microsoft rolled it back on 1/21/2021. Explanation from the support site below

Flow Support

Serial Dates Explained

Let’s start with a little background.  Cells in an Excel Table that are formatted as Long Date, Short Date, Time, or with one of the Custom time and date formats store their values as a Serial Date. Serial dates represent the number of days (and fractional days) that have passed since January 1, 1900. The time portion is stored as a fraction between 0.0 and 0.99999, where:

  • 0.0 is midnight 00:00:00 (hours:minutes:seconds)
  • 0.5 is noon 12:00:00 (12 p.m.)
  • 0.99999 is 23:59:59

Note: For calculation purposes we’ve always used 12/30/1899. This is because January 1 = 1 so the 0 day is actually 12/31/1899. We have to subtract one more because 1900 didn’t have a February 29th for leap year and the formula assumes that it did. So for calculations you are off by 2 days automatically.

In the past Dates, Times, and custom formatted dates where brought into Power Automate from Excel using a List Rows action as the actual serial date stored in Excel. If you look at the example below you can see the serial dates in the JSON.

serialDates

New Excel Online List Rows Behavior

The List Rows action in the Excel Online connector now brings Dates, Times, and custom formatted dates into Power Automate formatted as ISO 8601 Dates. Here’s a screenshot of the previous List rows action when I ran it today.

TimeDateISO

As you can see the dates are now listed in a format that is directly readable without doing extensive calculations.  Since Excel reports Dates and Times in a time zone neutral format all Dates and Times are considered Universal Time Code (UTC) for ISO 8601. This explains the ‘”Z” at the end. But whether the cell was formatted as Time only, Date only or a custom Date and Time field it is now translated to a full DateTime value.  The 3 fields in the screenshot represent the 3 different possibilities when retrieving Date time cells from Excel.

  • “Excel time” is a cell formatted as Time only so the time is reported accurately but the date defaults to 12/30/1899. See the note above for an explanation of why this is the zero date.
  • “Excel Date” is a cell formatted as Date only so the date reads normally, but the time defaults to midnight in UTC.
  • “Power Apps” is a cell formatted using a custom Date Time format in excel of “m/d/yyy h:mm”.

ISO 8601 Date Time Format Explained

ISO 8601  is an international standard used to represent date and time related data in an format that can be used to transfer it between applications. It is maintained by the Geneva-based International Organization for Standardization (ISO) and was first published in 1988. The purpose of this standard is to provide an unambiguous and well-defined method of representing dates and times, so as to avoid misinterpretation of numeric representations of dates and times, particularly when data is transferred between countries with different conventions for writing numeric dates and times. The combined Time and Date use the following pattern “YYYY-MM-DDTHH:MM:SS:xxxZ

  • YYYY is the 4 digit year to avoid a year 2000 issue
  • MM is the 2 digit month
  • DD is the 2 digit day
  • T denotes the seperation of the Date portion from the Time portion
  • HH is the 2 digit hour in 24 hours 0-23
  • MM is the 2 digit minute 0-59
  • SS is the 2 digit second 0-59
  • xxx is the fractional seconds
  • Z specifies that the Time/Date is in the UTC time zone

What this means going forward

The good news is that this means you don’t have to use a long formula to get the datetime field into a date format.  The bad news is that you no longer get a number that is easy to use in calculations.  Here are some simple formulas and actions you can use to work with the new ISO 8601 formats in Power Automate.

Converting ISO8601 to a Serial Date

This first formula will be useful if you need the datetime from Excel as an actual Serial Date value.  Let’s look at the formula working from the inside out.

div(add(div(float(ticks(‘ExcelDateField’)),10000000),-59926435200),86400)

  • ticks(IsoDate) converts the ISO 8601 date to the number of thousandths of a second since 01-01-1900
  • float(value) makes sure the result is treated as a floating decimal point number for future computations
  • div(value,10000000) there are 10,000,000 thousandths of a second in a minute. So dividing by 10 million gives us the number of seconds since 01-01-1900
  • add(value,-59926435200). There are 59,926,435,200 seconds from 01-10-1900 to to 12-30-1899. So subtracting that gives us the number of seconds from 12-30-1899 to the date
  • div(value,86400) There are 86,400 seconds in a day.  So dividing by 86,400 gives us the days with the fractional days since 12-30-1899.  This is the same value as the serial date in Excel.

Converting from UTC to local time

One of the problems that arise in the new formatting is that the Serial date in Excel is time zone independent.  There is no time zone implied or stored with the date time. But Power Automate stores all DateTimes as UTC. So when a time independent value is imported it is assumed to be UTC and is displayed that way in the the ISO 8601 format.

This means that dates can shift based on the local time zone if your flow doesn’t account for the time zone shift.  For example, if I enter a date of 2021-01-15 8:00PM in an Excel spreadsheet directly and then try to use it in a local flow to schedule a meeting then the meeting will be scheduled for 2021-01-14 2:00 AM since I live in the Central US time zone which is currently 6 hours behind UTC. This becomes even more complex when you realize that as soon as Daylight Savings time hits I’ll be 7 hours behind. So you have to be very careful to shift the time zone to take those things into account.

There is unfortunately no way to tell a flow to treat the DateTime value in a time zone independent fashion.  There are a number of functions and actions that make it easy to convert from one time zone to another.  But this won’t help in the example above because converting the date from UTC to a local time zone will change the actual date and time.  Instead you have to adjust for the time zone offset yourself before converting to the local time zone. If you know what the time zone offset is you can easily use the following formula to adjust the UTC time to be what it should be when converted to the local time zone.

convertFromUtc(addhours(ExcelDateTime,timezoneoffset, ‘o’), ‘localtimezone‘)

Where

  • ExcelDateTime is the UTC time imported from Excel
  • timezoneoffset is the number of hours difference between the local time zone and UTC. Note: this will vary depending on whether Daylight Savings time is in effect or not.
  • localtimezone is the name of the local time you wish to convert to

In my case the timezoneoffset is 5 hours currently because my time zone is 5 hours behind UTC.  So if the DateTime from Excel is 2020-10-01T03:00:00.000Z then the converted value after the formula will be 2020-10-01T03:00:00.0000000 in Central Standard Time.

Conclusion

Hopefully this post has provided the information you need to adapt your Power Automate flows to the new connector settings. In general this change should make working with Dates and Times easier.  But it will break existing flows until provisions are made for the new format.

Emailing File Attachments from Forms with Power Automate

Forms FlowI’ve seen some questions recently on the Power Platform Forums about how to send multiple attachments submitted in Microsoft Forms in an email.  Since this seems to be a common problem I thought it would be good to walk through the steps in a BLOG post.

  1. Once you have a Microsoft Form created that includes a question with an attachment you can create a new Power Automate Flow that uses the “When a new response is submitted” trigger.  That will start your flow each time a response is submitted through Microsoft Forms. But the trigger alone won’t provide enough detail about what is in the response.  So you also need to add a “Get response details” action to retrieve the questions and the answers submitted in the form.
    Get Form Details
  2. In order to submit more than one file attachment to the email you will need to create an array to hold the name and content of each file.  To do this we “Initialize a variable” of type array.  We will supply values for the array later in an “Apply to each” loop.
    InitFileArray
  3. Now you are ready to retrieve the details of the files attached to the question in the response and add them to the array.  To do that you need to use “Parse JSON” to parse the contents of the question in the response where the files were uploaded. Run your flow once at this point to get some sample output that you can use to generate the JSON schema.  Then add your question content to the Parse JSON.
    parsejson
  4. Files uploaded to a Microsoft Form are automatically stored in the Form creator’s OneDrive for Business account.  So now that we have access to the details of those files from the Parse JSON action we can retrieve the file content from OneDrive and append it to the Array we created in Step #2.  We’ll use the file id to retrieve the file and then add the Name of the file and the File content to the array. Whether there is one file or multiple files the details will be in an array, so we’ll need to use an “Apply to each” loop to get each file and append it. The File content can ge used directly as we retrieve it from OneDrive.  No translation to Base64 is required because the file is retrieved as JSON, not binary.
    AppendToArray
  5. Now that we have the file content in an array we can send the email.  Be sure to click on the selector in the attachments section to switch from detail inputs to an array item.  Then just fill out the email and add the array variable to the Attachments field.
    SendEmailAttachments

Now you can save and test your flow by filling out the Microsoft Form and uploading one or more attachments to the form.  In under 5 minutes you should get an email with the attachments from the form.

13th Year as an MVP

mvp13July 1st is always a day that I both look forward to and dread.  That’s the morning I find out whether my MVP status has been renewed or not. I really started worrying this year when I saw lots of my friends and colleagues announce their re-awards at a little after 11:00 AM Eastern time.  By noon I was convinced that I had not been re-awarded. The one piece of hope that I tried to hold onto was that MS said they would send emails to all MVPs with the re-award decision whether they were re-awarded or not. With a sigh of relief I finally got my email around 12:30 Eastern time.  I’m not sure why my email was later than it has been in previous years, but it was a reminder to me how much I value being an MVP. I am particularly honored and grateful for Microsoft’s continued recognition this year.

But now its time to plan for the new year.  The Covid-19 pandemic has really cut into my time speaking at conferences, since most conferences have been cancelled or postponed.  But I have spoken at a couple virtual conferences this spring and as fall approaches it looks like I will have a busy schedule speaking at conferences that were postponed from earlier this year.

Over the last year I’ve been spending a lot more time working with Power Apps and Power Automate, particularly as it applies to SharePoint and Teams.  In addition to being re-awarded as an MVP I’ve also been named a Dual Super User in the Power Apps and Power Automate community forums. With the announcement last week that SharePoint workflows are going away these two areas will become even more important for working with SharePoint online.

So here’s to another year as an MVP. I’m really looking forward to it.