Monday, November 3, 2014

Get it running on your IOS Device

Create new Unity project
Create a new Unity project. Right click in the Project panel and select Import PackageCustom Package to import  metaioSDK Unity package:


Once package has been imported, the following changes are required:

Add a user layer

Click on Layers drop down at top-right corner of the Editor and select Edit Layers.

Add a new layer in next available User Layer, e.g. call it "metaioLayer".

Set Application Signature

For each application you need an unique signature. How to generate a signature is explained here.
After creating a signature, you could start creating your own application.  Delete Main Camera object created by default and instantiate a metaioSDK prefab by dragging and dropping it into hierarchy view of your project.

Select metaioSDK in the Hierarchy panel and then in the Inspector view set the previously generated application signature.


Important: If an invalid application signature is provided, the plugin will fail to load.

Adding tracking configuration

Create the required tracking configuration. See here for a guide.
----------------------------------------------------

Create an application signature


Creating an Application Signature is free of charge. The following steps are required:

  1. Register at the Metaio Developer Portal
  2. Add the Application Identifier (i.e. Application ID / package name) of your application. This will instantly create an according signature that corresponds to the Application ID. You will receive it via email or you can use it directly from the developer portal.
  3. Copy & paste the signature into your application for using it with the function CreateMetaioSDKIOS() or CreateMetaioSDKAndroid() (depending on the according platform). 

-----------------------------------------------


Create StreamingAssets folder in your Assets folder and copy there tracking configuration with respective patterns.
Select metaioSDK in the Hierarchy panel and then in the Inspector view select StreamingAssets in a drop down menu Select Configuration. Then you could simply drag and drop your tracking configuration file to the Inspector view.

Binding Unity game objects with tracking data

Instantiate a metaioTracker prefab by dragging and dropping it into hierarchy view of your project. Metaio Tracker instance is a reference in your Unity project to a corresponding COS in your tracking configuration file. Note that you have to set Coordinate System ID that corresponds to a valid COS in the currently set tracking data.
Once it has been done, you could attach new game objects to metaioTracker instance.

Listening for metaioSDK callbacks

The metaioSDK callbacks can be received by extending metaioSDKCallback class, e.g  QRCodeReader example.:

public class QRCodeReader : metaioCallback {    override protected void onTrackingEvent(List<TrackingValues> trackingValues)    {        foreach (TrackingValues tv in trackingValues)        {            if (tv.state.isTrackingState())            {                string[] strList = tv.additionalValues.Split(new string[] { "::" }, 2, System.StringSplitOptions.RemoveEmptyEntries);                if (strList.Length > 1)                 {                    GetComponent<QRCodeReaderGUI>().setCode(strList[1]);                    Debug.Log("QR code read:  "+strList[1]);                }            }        }    }}

The behavior can be attached to any GameObject.
Important: The metaioSDK GameObject by-default enabled base metaioSDKCallback behavior mainly for logging. This should be disabled, so that your callback receives the events.

Build and Run

Everything should be configured now, press "Build and Run" (or CTRL+B if you prefer) to run it on the device.
The default tracking configuration will track the following pattern and display the famous MetaioMan character (once it was binded in Unity as it was explained in previous step):

Change Build Settings (Android, iOS)

Go to FileBuild Settings, select Android or iOS. In the Inspector, select "Landscape Left" as default orientation for all platforms.
Click "Other Settings" in the Inspector and set Bundle Identifier. This bundle identifier will be used to verify application signature (see Set Application Signature step).

Android

For Android, change the following as minimum requirement to run metaioSDK plugin:
  • Set minimum API Level to 10 (Android 2.3.3 Gingerbread)
  • Set ARMv7 only for Device Filter
  • Set OpenGL ES 2.0 for Graphics Level (optional)

iOS: Adding the library and necessary frameworks

After exporting the Unity project to Xcode, the Unity Plugin has to be added to the project, as well as some external frameworks. Also, please select ARMv7 only in the iOS project settings.
To do that, just drag the metaiosdk library right into Xcode:


After this is done, please add the following frameworks to the project:
  • libc++.dylib
  • libxml2.2.dylib
  • Security.framework
  • CoreImage.framework (SDK 5.5 and newer)

To enable GPS support you have to add these keys to the projects Info.plist:
  • NSLocationWhenInUseUsageDescription (for iOS8)
  • NSLocationUsageDescription (for ios6 and ios7)

If you push 'Run' the application will then link successfully and run on your device.


This video is a bit dated but has the core of the work flow-
***we are not working with play maker

Monday, October 27, 2014

Siri-type-voice speaking/reading open source software?


Does anyone know any open source software for a voice that can read text well? For example, a voice + clarity in speaking like Siri's?

Not sure what this mechanism is called.

I am looking into Jasper for voice recognition, but I also need a voice to "talk back".

Any help would be appreciated! (ksfatima@nyu.edu)

smart terrain 2

Thursday, October 23, 2014

YOUR work in INside AR Germany 2014!!!!



Hey guys -
Inside AR is coming up Oct 29-30 in Germany-!!!!!!!
http://www.insidear2014.com/

This is considered to be the biggest AR event in Europe..
Brendan is giving a Keynote and would show a specific class project-
*** You would have to create something for Grand Central Terminal and go there-
Document it- I cold help you-
Here is a project I proposed for a class assaingment when I was a grad- [the top one]- http://www.markskwarek.com/upcoming_project.html

He wants you to use the point cloud + metaio creator- He made a 3d map of the terminal-

There is a small chance if what u made was amazing that it could be an official app for GCT...
No promises but a great opportunity!!

If you want in email me and I can send u the 3d map he made-
Be creative + talk to me and I can help you-
polytech3d@gmail.com
Id give u bonus points for people who help out-

Thx!!

Mark

Wednesday, October 22, 2014

Magic Leap Secures $542M Led By Google For “Lightweight Wearable” Tech That Merges Physical And Digital Worlds

Magic Leap Secures $542M Led By Google For “Lightweight Wearable” Tech That Merges Physical And Digital Worlds

Next Story
It’s rare that a company can stay relatively secretive while raising a huge amount of funding, but Florida’s Magic Leap has managed that. The startup, led by CEO Rony Abovitz, announced today the close of its $542 million Series B, featuring investors led by Google, Inc., and including KPCB, Andreessen Horowitz, Obvious Ventures, Qualcomm and Legendary Entertainment.
The list of investors reads like a who’s who of influential companies and individuals across various industries, and Abovitz explained to TechCrunch that the reason for that is that the tech’s potential isn’t limited to any one field, which he says puts its potential market size in the trillions of dollars annually range. That could explain the valuation of Magic Leap, which is north of $1 billion, given that this round is still a minority investment, per Abovitz.
But what is Magic Leap? It’s a question that the startup isn’t answering in detail just yet, though they are pulling back the curtain just a little more than they have in the past with this fresh funding.
“If you think about what mobile computing is right now, it’s portable, it’s great, and I call it ‘making your hand happy,’ in that you can hold it and it’s great,” Abovitz said. “Your hand is happy, but your eye is not. What I mean by your eye is not happy, if you step outside your office and look at San Francisco Bay, it’s just this visual feast, and there’s no movie theater, there’s no television display, there’s nothing that will ever match the grandeur of what our own brains can create in terms of visual experience.”
Magic Leap, then, is combining that inherent visual ability with mobile computing – giving you visual output equivalent to when you step outside into the world, but powered by the mobile tech you carry around. Nor will this be something that involves a huge head-mounted display, Oculus Rift-style, Abovitz is keen to note – he characterized it as a “lightweight wearable” hardware solution, though he wouldn’t go into further detail about what exactly that meant. Based on his comments, it sounds like artificial, but extremely realistic images like the one shown in the image above might be projected directly onto a user’s retina to achieve this effect, but we may have to wait until an official reveal to learn more about the nature of the device(s) in use here.
What Abovitz would tell me is that they think of Magic Leap’s capabilities in terms of both the phrases “the world is your new desktop,” and “the world is your new silver screen,” meaning it provides a visual experience not bound by traditional media content consumption devices. The use of both those phrases also hints at some of the potential markets for the tech – silver screen includes Hollywood in the mix, which helps explain why both Legendary Pictures, and Legendary Pictures CEO Thomas Tull personally invested in Magic Leap as part of this round.
“I was an Oculus Rift investor, and they’re certainly doing some amazing things,” Tull explained in a separate interview with TechCrunch. “Magic Leap takes a completely different approach, and all I can say is that as I got to know Rony [Abovitz] and we got to really know and like each other this past year, and I went to their headquarters and I spent half a day immersed in [their technology], I just couldn’t get the smile off my face.”
Magic Leap
Abovitz, for his part, says that Magic Leap isn’t like Oculus, in that it’s not truly a VR experience. Nor is it an augmented reality situation, he claims, since it goes well beyond that and provides truly integrated, 3D digital objects that looks as though they were physical objects, alongside the real world. He likens Magic Leap compared to other AR-type tech to a situation whereby, if you’d come to see the Wright Brothers fly their original airplane in 1903, only to learn that someone else was building a jet in the next hangar over.
Google is a key investment partner here, and Google’s Sundar Pichai, who leads Android and Chrome, will join Magic Leap’s board as part of the deal. Qualcomm Executive Chairman Paul Jacobs and Google VP of Corporate Development will as join the board in observatory capacity, so you can tell the industry will be watching what Magic Leap can do closely. Abovitz says that contrary to some speculation, however, this isn’t just about adding a feature to Google Glass – in fact, he says they’re completely separate and unrelated projects, and will remain so, though he did say Magic Leap springs from a belief that we spend too much time looking at our phones and not enough looking at the world, which is similar to Sergey Brin’s stated motivation in creating Glass.
Magic Leap should become more of a known quantity with a consumer launch “relatively soon” per Abovitz, and the investment is going to be focused specifically into product development, which can be pricey when you’re building hardware. He also says that while he admires Oculus Rift’s ‘iterate in the open’ product development strategy, Magic Leap will not be going down the same path, so it’s possible than when we see product revealed it’ll be available for general consumption shortly after. Whatever comes out of Magic Leap, it’s bound to be worth watching, given how much money and attention it has garnered from some of the smartest and most successful minds across computing, film and technology thus far.