Every drone pilot using way point planning software (a.k.a. a ground station app) is familiar with their standard workflow: You start the map-based software on your tablet and search for the location in which you plan to fly. Then, a long and tedious process of placing way points, i.e. points in 3D space representing physical locations in space, starts. You are required to specify the location and attributes (altitude, camera angle and pitch, action etc.) of every way point the drone is required to pass through during the flight, all in a form-based 2-dimensional interface.

The latter process can be used, for example, to plan automatic flights for taking pictures of a building, or sculpture, recording a scenic flyover of a hill, or a beach, inspecting the perimeter of facility and more. While undeniably simple, and some would argue, intuitive, this process has several obvious drawbacks. Firstly, it is very time consuming, as each way point needs to be defined separately, with all its attributes, typically in a flat 2D user interface. Secondly, the lack of proper visualization of the resulting plan leads to many planning errors: wrong altitudes, bad camera angles, obstacles on the path between consecutive way points and more, leading to re-planning after bad flights, which again, results in more way point handling, longer flight times, and overall slower process. Finally, and perhaps most importantly, this planning process is to a large extent oblivious to the actual task at hand! If you are out there to make nice pictures of your house, why not tell the app what your house looks like and what you want to do, and let it figure out a good way point mission for you?

The Drone Harmony Mission Planner is designed around Scene-Centered Planning, a planning paradigm that focuses on user’s needs, instead of defining way points. The process starts by specifying relevant objects in the scene: buildings to inspect, obstacles surrounding them, fields to scan and so on.

Drone Harmony Flight Planner: Drawing areas and obstacles.
Drawing areas and obstacles in Drone Harmony’s Flight Planner

The scene can be visualized in the Drone Harmony 2D and 3D views and adjusted before the flight planning starts.

Drone Harmonys Flight Planner: Simple waypoint editing in 2D view.
Drone Harmony’s Flight Planner provides simple tools to edit single or multiple way points in 2D. Shown camera angles and distances to the nearest structure helps adjusting your flight plans better.
Drone Harmonys Flight Planner: Editing in 3D with real time camera preview.
Drone Harmony’s Flight Planner allows editing in 3D. Added lighting in the scene highlights the exact content of the image at each way point.

Based on the defined scene, the user can select any one of several professional complete flight plans to be automatically generated. Each plan is defined to cover a user-defined part of the scene. Different plans have different applications. For example, a Top-Down plan is useful for inspecting any part of the scene from above, either by taking pictures, or a video. A perimeter plan is useful to inspect the walls of a building, or to search for damages in a fence surrounding a mining facility.

Drone Harmonys Flight Planner: Six flight plan types.
Drone Harmony’s Flight Planner comes with six professional flight plan types.

Plans can be generated with default parameters, but can also be fine-tuned to the specific needs, using scene-based parameters such as image overlap, distance from scanned structure etc.

Drone Harmonys Flight Planner: Customize flight plan computation
Drone Harmony’s Flight Plan computation can be highly customized while keeping default settings gives good results for most missions.

The generated flight plans are optimized for flight time and coverage of the selected structures. Furthermore, Areas serve as obstacles, that are automatically avoided by all plans! This means that you no longer need to rely on obstacle avoidance sensors to guide your drone around known obstacles, but instead outline them on the map and let Drone Harmony optimally fly around them, while taking the best possible footage for your needs. Obstacle avoidance sensors can of course still be kept on to increase safety in case of unexpected or unknown obstacles. Finally, to eliminate any remaining uncertainty, plans can be reviewed in a full 3D environment and further tuned in any way before takeoff, and even during flight!

workflow
The result of the scene-based workflow of Drone Harmony: Perfect flight plans.

Can we do without way points specifications altogether? Of course not. Way points are the basic constructs of any flight path, and as such, any flight planning software needs to include flexible way point definition and editing tools. The Drone Harmony app is designed to consider any flight plan, be it automatically generated, or manually created, as a way point mission. This means that you, the user, can at any point intervene to adjust your plan to your needs by changing anything from the position of single way point to the attributes of all way points in the plan simultaneously, both in 2- and 3D. In fact, while primarily being a scene-centered planning tool, Drone Harmony provides the most powerful way point engine on the market to support flexible tuning of automatically generated flights and more.

In summary, Drone Harmony lets you plan missions not only by means of way points, but also by creating a scene, an in-app 3D representation of the physical objects that are relevant to your flight, for which Drone Harmony generates optimized, safe and adjustable flight plans that are tailored to your task and visualized in a full 3D environment.

5 thoughts

  1. What about basic flight parameters of DJI in the app like drone Battery remaining and safe or auto RTH if battery is low or down to minimum for distance from homepoint.
    Is all this still accounted for in the app or still needs to be implemented. They are just basic drone safety features of any flight.

    Like

    1. Hi Peter,
      Thank you for your interest and your questions.

      1. The remaining battery status you can see on the top bar.
      2. The safe or auto return to home (RTH) of DJI works, but you can not access these settings currently through our planner. We will add the UI layer for accessing these DJI settings soon. For now you can use DJI GO 4 to adjust the settings.

      I will update our website FAQ to include your excellent questions, thanks again!

      Best,
      Martin

      Like

  2. Really like your 3D planner, not to mention the camera field of view representation, missed so much such feature on other apps (had to do it myself on Photoshop over maps).

    If I get it right, we will be able to change the mission on the fly. It is very common while using Litchi (for example) that you reach a waypoint only to find the camera is too close/far to the subject.

    It would be perfect to stop, rewind a little, move the waypoint and then resume flight. Can we do that with Harmony?

    Like

    1. Hi Eduardo,

      Many thinks for your comment. I’m happy you like our planner.

      In fact, if I understand you correctly, the planner as is now already supports what you need.

      First, you can pause the mission mid-flight at any time, edit any part of the plan– just as you would do in the map view during planning– and then tap continue to resume the updated mission. This way you can move waypoints that you realized are in the “wrong place”, either due to the image content, or due to an obstacle that was not included into the scene. You can also adjust the speed mid-flight without pausing. By setting a negative speed you “rewind” the mission and re-fly some parts of it again. all without ever stopping the mission. You can of course also combine: during flight you realize that some images are not quite what you need. You rewind by setting a negative speed, then set the speed to positive again, then pause the mission and edit the waypoints that need editing and then continue.

      Hope this helps. Looking forward to thoughts.

      Best,

      David

      Like

Leave a Reply

Fill in your details below or click an icon to log in:

WordPress.com Logo

You are commenting using your WordPress.com account. Log Out / Change )

Twitter picture

You are commenting using your Twitter account. Log Out / Change )

Facebook photo

You are commenting using your Facebook account. Log Out / Change )

Google+ photo

You are commenting using your Google+ account. Log Out / Change )

Connecting to %s