News & Vacancies
Welcome to the Microtechs information portal. Here you can see the latest news and read through our current vacancies.
Tracking humans in 3D with off-the-shelf webcams
Whether it's for computer games, motion analysis in sports, or even medical examinations, many applications require that people and their movements are captured digitally in 3D in real-time. Until now, this was possible only with expensive systems of several cameras, or by having people wear special suits. Computer scientists at the Max Planck Institute for Computer Science have now developed a system that requires only a single video camera. It can even estimate the 3D pose of a person acting in a pre-recorded video, for instance a YouTube video. Hence, it offers new applications in character control, virtual reality and ubiquitous motion capture with smartphones.
"This lets you capture video with your cell phone out in the Alps and do body tracking. Doing this in 3D, in real-time and just with a camera like the one on your mobile device -- that is a big leap," reports Dushyant Mehta, PhD student in the Graphics, Vision and Video Group headed by Professor Christian Theobalt at the Max Planck Institute for Informatics in Saarbruecken (MPI).
Together with his colleagues, he developed a software system that needs only a conventional camera to digitally capture a person, along with their movements, in real-time.
"So far, several video cameras, or a so-called depth camera as in the Kinect, have been necessary for this task," explains Srinath Sridhar, also a researcher in the Graphics, Vision and Video Group.
The new system is based on a neural network which researchers call a "convolutional neural network," or CNN for short, that is often associated with the term "deep learning." The MPI researchers have developed a new method to calculate the three-dimensional pose of the person from the two-dimensional information of the video streams with the aid of a neural network.
A short video on their website, produced by the scientists, shows what this looks like. A researcher juggles with clubs in the back of a room, while in the foreground a monitor shows the corresponding video recording. The figure of the researcher is here superimposed by a simplified, red stick figure. Another 3D view shows the motion from the side, showing that, for the first time, the full 3D pose is captured in real-time. No matter how fast or how far the researcher moves or extends his or her limbs, the stick figure makes the same movements in 3D, just like the more fleshed-out virtual character version in the virtual space, shown on another monitor to the left.
The researchers call their system "VNect." The system both predicts both the 3D pose of the person in the image and localizes the person in the image. This allows the system to avoid wasting computations on image regions which don't contain a person. The neural network of the system is trained using tens of thousands of annotated images during the machine learning process. The system provides 3D pose information in terms of joint angles, which can easily be used to control virtual characters.
"VNect makes 3D body pose tracking for virtual reality of computer games accessible to a wider audience because they don't need to have Kinect or other cameras available, don't need to wear special sits, and can just use webcams which are more readily accessible," says Mehta and adds, "It also enables new experiences in first-person virtual reality." Besides this interactive character control, VNect is the first system which can also be used to estimate the 3D pose of a person in community videos such as those provided on the online platform YouTube. Christian Theobalt continues: "There are many other applications possible, from Human-Computer-Interaction to Human-Robot Interaction to Industry 4.0, where man and robot work together in a factory. Also think about autonomous driving, where the car may in the future estimate the full articulated motion of people from a color camera to assess their behavior."
But VNect still has its limitations. The accuracy of the pose estimation is a bit lower than the accuracy obtained with multi-camera or marker-based pose estimation. It gets into trouble if the face of the person is occluded, the motions are too fast or the poses are too far away from the trained set of poses. Occlusion by multiple persons is a problem, too.
Nevertheless, Sridhar is sure that the technology will further mature and be able to handle increasingly more complex scenes, so that it can be used in everyday life.
Story Source: Materials provided by University Saarland. Note: Content may be edited for style and length.
Microtechs 24/7/365 White label Technical Helpdesk
In today's world, a rock solid IT infrastructure is key to every successful business. At Microtechs we have the experience and resource to ensure your company has the support it needs 24 hours a day, 7 days a week, 365 days a year. We are able to provide an immediate response from our state of the art Technical Operations Centre which is based in the heart of Surrey.
With our rapidly expanding team, all specifically trained, working 24/7/365, we are able to provide excellent customer service and technical support. All of our services are available completely white labelled, ensuring a seamless extension to your company.
Through our services you are able to extend your hours to 24/7 or simply use us as an over flow assistant during office hours. This is all tailored to your business needs.
How does Outsourcing your helpdesk benefit your business?
1. It reduces your staffing costs. Why hire another member of staff, if you can outsource all of your calls for less? We are normally between 25-50% cheaper than an in-house option.
2. It expands your opening hours. We have a technical operations centre which is open 24/7/365.
3. It will improve your customer experience. Are you taking multiple calls from clients, but can’t get back to them as quick as you would like? Well now you have a team of 30 staff taking your support calls for you. Have an important meetings? No problem, your helpdesk has your back.
We work with over 60 IT & Telecoms Businesses who trust us to deal day to day with their clients.
Feel free to call our friendly solutions team, who will be happy to discuss further and help tailor a solution to you.
Call us now on 01483 407417