#iot

Smart Contract Platforms to keep an eye upon

Posted on by News Aggregator

By sanro mathew

Just like every other flourishing technology, smart contracts are showing its impact on different forms of businesses. The traits which these smart contract platforms possess are that of clarity, efficiency, scalability, and they certainly are completely unrivaled with the other technologies of this era. These contracts successfully abolish the middleman thereby providing its service […]

The post Smart Contract Platforms to keep an eye upon appeared first on IoT – Internet of Things.

Read more here:: iot.do/feed

Couchbase to Deliver Parallel JSON Analytics — Without the ETL

Posted on by News Aggregator

By Alex Woodie

Couchbase yesterday unveiled a JSON-native analytics engine it claims will let users perform parallel ad-hoc analytics on operational data just milliseconds after it’s landed in the NoSQL store. The Analytics Service, which is based in part on the Apache AsterixDB and SQL++ projects from academia, has been dubbed “NoETL,” but don’t let the catchy phrase fool you.

The new Analytics Service is the cornerstone of Couchbase Server 6.0, which the company launched yesterday at its Couchbase Connect SV conference at the San Jose-McEnery Convention Center, and which is slated for delivery in October. The company dedicated a significant portion of the one-day show to explaining how it built the new analytics engine, what impact it will have on customers, and running a real-time demo where it spun up an analytics cluster in less than five clicks.

For many businesses, analytics is heavily dependent on the extract, transform, and load (ETL) process, whereby data is lifted out of a production system and shunted over to a data warehouse. But ETL processes can take months to define, are susceptible to shifting schemas, and typically require flattening of the rich hierarchical data structures that exist within JSON documents.

Numerous methods have been devised to bypass ETL, including the Lambda architecture, where data streams are split into separate pipelines and landed in various optimized stores for operational or analytics use case. Another technique, dubbed hybrid transactional analytical processing (HTAP), has been put forth by the smart folks at Gartner as a more efficient way to analyze data as it sits in production systems, usually scale-out relational databases. (Increasingly, real-time stream processing systems, in-memory databases, and even in-memory data grids are being called on to solve the same elemental problem, but that’s another story.)

Couchbase CTO Ravi Mayuram and UCI professor Mike Carey on stage at Connect SV September 19, 2018

Couchbase’s new Analytics Service takes a page out of Gartner’s HTAP playbook, but with substantial caveats, including provisions to maintain the rich JSON data structures that customers rely upon to serve their operational computing needs. The company began researching what a native-NoSQL HTAP system would look like four years ago, when Couchbase CTO Ravi Mayuram reached out to University of California Irvine computer science professor Mike Carey about a project he was working on called AsterixDB, which Carey started about 10 years ago in response to the seismic architectural shift that was occurring.

“There was an elephant in the room, Hadoop, which was starting to happen,” Carey told Mayuram on stage at Couchbase Connect SV. “Clearly the data was a mess. It was a much more complicated that rows and columns. And databases were kind of being forgotten. So people were kind of reinventing that technology without being aware of it. Those of us who were SoCal database people said, this is not the right way to go. Let’s build a parallel database for that kind of flexible data, and that was the Asterix project.”

Couchbase worked with Carey as an advisor, and used the open source AsterixDB as the foundational technology for the new database engine component of the Analytics Service that has been in beta for the past six months (and which will not be open source). There was a considerable amount of work that went into pairing the new database engine to work with the Couchbase database. Much of the work involved adapting Couchbase’s Data Change Protocol (DCP), which is basically stream protocol that provides very fast memory-to-memory replication of data sitting in the NoSQL engine, to work with the AsterixDB-based technology that would become Analytics Service.

“There were two big technical problems,” Cary said. “One is you were doing a lot of transactions on front end, gathering a lot of data that had get swallowed into the system where you could ask the big questions without perturbing the front end. So it was a data ingestion issue there. We had to look at how could get the data in so that it moved quickly, and how do it we get it at rest quickly so that you can query it.”

The solution hinged on the “data feeds” technology that Carey and his UCI researchers developed for AsterixDB, which Couchbase utilized as the basis for the log-structured merge trees, or LSM-trees, that do the work to land the data on the separate Analytics Service nodes in a way that makes them query-able.

Next, the company needed a query language to pair with the database engine and the table-like views of JSON data materialized by the in-memory LSM-tree algorithms. The company already had N1QL, which is very similar to SQL and provides some analytic capabilities for native JSON data. But N1QL had some shortcomings that made it a poor fit for the new service – namely, it did not run in a massively parallel fashion to leverage Couchbase’s shared-nothing distributed architecture. And N1QL needed data to be pre-organized with indexes, which eliminated analyst’s ability to run ad-hoc queries to explore the data.

The phrase “NoETL” was first coined by Alexy Khrabrov, according to Wikipedia, and is currently the subject of a trademark application by By the Bay LLC (Image source: OpturaDesign/Shutterstock)

This is where Couchbase dipped into the academic waters a second time, and it pulled out a technology called SQL++, which is a declarative query language for JSON data that’s backwards compatible with the ANSI SQL standard. SQL++ is the subject of an ongoing research project at University of California, San Diego under computer science and engineering professor Yannis Papakonstantinou, which has been funded in part by a grant from Couchbase.

There was more work in getting SQL++ to work with Couchbase before it delivered it as the first commercially supported implementation of SQL++, which the comapny is doing with N1QL for Analytics, which utilizes SQL++ under the covers. “We had to optimize it, number one to understand DCP, then bring it into the Couchbase domain,” Sachin Smotra, director product management at Couchbase, told Datanami. SQL co-creator Don Chamberlin, who is an advisor to Couchbase and appeared on stage yesterday, has been involved with SQL++ and also helped the company with the implementation.

The fourth piece of the puzzle revolved around maintaining isolation from the transactional side of the Couchbase cluster. The company did some work to ensure that customers would not be subject to the “noisy neighbor” problem, whereby big SQL++ queries (via NiQL for Analytics) begin to consume resources and impact performance of the transactional cluster. The company, which recently introduced a Kubernetes operator, says customers can get separation either with dedicated hardware or containerized workloads.

When you put all this together, you get Analytics Service, which is the fourth fifth optional component in the NoSQL data platform, along with mobile, eventing, and N1QL query. During a demo on stage, Smotra and Mayuram went through the process of “re-balancing” data from the production Couchbase cluster into an Analytics Service (in only four clicks) and then running a series of queries to discover what was occurring with hypothetical IoT data set from a connected car system. There were anomalies detected in tire pressure monitoring system (TPMS) systems, and the Couchbase execs demonstrated how quickly customers could ask questions of the data, visualize the results (through a Knowi layer), and then run new queries based on the results (such as determining if there were patterns in the data, like specific models or years exhibiting the same TPMS anomalies). Such free-ranging inspection of the data comes intuitively for humans, but it’s actually a really challenging technical thing to pull off with machines that haven’t organized the data that way.

The delivery of Analytics Services with Couchbase Server 6.0 will be the third major feature delivered in 12 months, following eventing and mobile, according to Couchbase’s SVP of products Scott Anderson

One early Analytics Service adopter that’s impressed so far is Steven Wyant, the data architect for the Cincinnati Reds, which started using a beta copy of the service about six months ago when the Reds started their baseball season. “I didn’t necessarily know what we were going to use Couchbase for off the bat,” Wyant told Datanami. “We had a bunch of things we wanted to look at.”

The Couchbase Analytics Service allowed the Reds organization to track what tickets people bought and where they actually sat within the 42,000-seat Great American Ballpark for (almost) an entire season, which delivered better in-game understanding of what’s happening during games, as well as better insight into potential price changes for 2019. “The [Analytics Service] allows for that in a quicker manner than N1QL, where you have to kind of know operationally what you’re after,” said Wyant, who previously helped Kroger build a Hadoop cluster for Hive analysis. “That’s really why we brought it in, to look at that in a more digestible and more interactive manner than what we can do in our current infrastructure.”

In the end, Couchbase pulled off its NoETL pledge in the demo, which was impressive. But equally remarkable is how it enabled analytics on JSON data via SQL++, without modifying it. That could appeal to a lot of Couchbase customers, who today must build and maintain ETL pipelines that flatten the JSON. “This is a really significant problem to solve,” says Scott Anderson, Couchbase’s senior vice president of product management. “You have this incredibly rich data structure, nested objects and so forth. How do you derive the intelligence beyond what we do with NIQL and how do we extend the capacity, and then solve some of the problems that Ravi talked about, which is the fragility of the pipeline?”

Couchbase executives fretted that they had hid too much of the complexity that went into Analytics Service and made it seem too simple in the demo. That led Mayuram to warn the attendees: “Don’t try this at home. Don’t think that you can solve this problem by hodge podging three different open source projects together. That’s not the case here….This is some serious stuff that we’ve built here.”

Related Items:

Couchbase’s Engaging Plan for Customer Victory

The New Math Driving NoSQL Analytics

New CEO, Same Strategy for Couchbase

The post Couchbase to Deliver Parallel JSON Analytics — Without the ETL appeared first on Datanami.

Read more here:: www.datanami.com/feed/

Will artificial intelligence have an impact on IoT sooner or later?

Posted on by News Aggregator

By Anasia D’mello

The market intelligence company IDC estimates that the number of connected devices and sensors to the internet will surge from 11 billion in 2016 to 80 billion by 2025. These devices and sensors will produce huge amount of big data, says Tushar Bhatnagar, IoT project manager with TechMahindra.

This data can hold extremely valuable information if used effectively; data that can help in real-time insights for the doctors, increase productivity across industries, create smart homes, help cities to predict accidents, provide communication between autonomous cars etc.

The possibilities that this data brings are endless and we need to formulate ways to analyse and process this big data with speed and accuracy.

However, this flood of data also brings along with it few challenges, such as:

How to manage, analyse and create meaningful insights.
How to ensure fast and accurate analysis.
How to balance between centralised versus localised intelligence.
How to balance between personalisation versus data privacy.
How to maintain security.

And Artificial Intelligence (AI) can be instrumental in removing some of these challenges and help make sense of this data and make sure that the Internet of Things (IoT) lives up to its promise. AI effectively enhances and multiplies the benefit and the impact IoT can have on the businesses who will adopt it. It has the capability to provide analytics that is required to extract meaningful information from the vast amount of data. In fact, AI is one of the key catalysts to grow IoT and take it to the next level.

Artificial intelligence can, in fact, help growth of IoT at three levels: –

Power of Prediction – At the most basic level, it can enable the power of prediction. It will be able to forecast what will happen? This will enable organisations to use the data to know when a machinery or a part is about to break so they can take appropriate action.
Power of Prescription – At a more advanced level, with intelligent sensors with logic to drive action means that it will be able to tell what should we do to avoid an outage or disaster. For example, railway track sensors can warn against track failures, or autonomous vehicles can course-correct when the car veers away from the centre of the lane.
Power of Adaptation – At the highest level, based on the continuous data feed the system will be able to learn to take the optimal action without human intervention. For example, in healthcare, blood glucose sensors can alter insulin delivery in response to changing patient needs.

Tushar Bhatnagar

I believe that IoT and AI are interdependent and should not be treated in silos. If we want them to reach their true potential, they both need to move forward hand in hand.

At one end IoT is able to generate huge amount of big data and needs AI to make use of this data, and on the other end AI needs huge amounts of data to grow and able to move towards a system that is able to take action without any human intervention.

It’s time that we let the machines help us […]

The post Will artificial intelligence have an impact on IoT sooner or later? appeared first on IoT Now – How to run an IoT enabled business.

Read more here:: www.m2mnow.biz/feed/

ARIN Bits: September 2018

Posted on by News Aggregator

By Kim Kelly

As we enter a new season, we’re happy to be back with another edition of ARIN Bits! We’ve been working hard this summer and want to fill you in on what we’ve been up to. In this edition, you’ll learn what’s on the ARIN 42 agenda, meet our newest Board Member, read about the draft policies under discussion, hear about our latest outreach initiative and so much more.

Missed last quarter’s edition? You can find all past editions on our ARIN Bits page.

Take a look at the agenda for ARIN 42 next month:

ARIN 42 is just a few weeks away! We hope to see you in Vancouver from 4-5 October at the Hyatt Regency Vancouver, directly following NANOG 74 in the same location. This will be a great opportunity to engage in policy discussions, network with colleagues, learn more about our services and operations, and attend workshops and tutorials.

If you can’t join us in Vancouver, remote participation is always an option and can be equally rewarding! In an effort to create a truly open community forum, we provide meeting materials, live transcripts, and webcasts so you can be part of the action, wherever you are. Remote attendees will also have access to a live chat as well as voting options to make sure your voice is heard. It’s the next best thing if you can’t be there in person. Be sure to join in for the policy discussions and also for candidate speeches on Thursday afternoon.

View the agenda.

It’s almost time to vote! Are you ready?

It’s almost time to vote in the 2018 ARIN Elections! Elections for two seats on the ARIN Board of Trustees, five seats on the ARIN Advisory Council, and one seat on the Number Resource Organization Number Council (NRO NC) will be held online 4-12 October. Take a look at this compilation of candidate biographies and questionnaire responses and submit your statement of support.

When it comes time to vote, eligible Voting Contacts from General Members in Good Standing should log in to ARIN Online and look for the “Vote Now” message on the dashboard. Additionally, all NANOG 74 and ARIN 42 meeting attendees registered for these meetings by 27 September (and who are not ARIN Voting Contacts) will be sent an email on 4 October with a link to vote in the NRO Number Council election.

If you have any questions about elections, email members@arin.net. Happy voting!

Congratulations Ms. Regenie Fräser!

We’re pleased to announce that during their 31 July 2018 Board of Trustees Board meeting, ARIN Trustees unanimously agreed to appoint Ms. Regenie Fräser to serve a one-year term on the ARIN Board of Trustees effective 1 January 2019, and in observer status in the interim period. Ms. Fräser served as the Secretary General of the Caribbean Association of National Telecommunication Organizations from 2004-2015.

The appointment is part of the ARIN Trustees ongoing commitment to Board diversity and fulfills the April Call for Volunteers of Caribbean background.

Congratulations to Ms. Fräser on her appointment! We look forward to her participation within and contributions to the ARIN Board of Trustees and the community.

We have a few Draft Policies under discussion, including:

Recommended Draft Policies:

  • ARIN-2017-12: Require New POC Validation Upon Reassignment
  • ARIN-2018-1: Allow Inter-regional ASN Transfers
  • ARIN-2018-3: Remove Reallocation Requirements for Residential Market Assignments

Draft Policies:

  • ARIN-2018-2: Clarification to ISP Initial Allocation and Permit Renumbering
  • ARIN-2018-4: Clarification on Temporary Sub-Assignments

You can find the status of current policy discussions and subscribe to ARIN-PPML (Public Policy Mailing List) to voice your opinions. And remember, membership is not required to participate!

We’ve released our Number Resource Policy Manual (NRPM) Repository:

In response to community suggestion 2018.1: Revision Management System for NRPM, we’re pleased to announce the release of the Number Resource Policy Manual (NRPM) Repository, a Markdown-based revision history interface utilizing the Git version control system.

This repository is available as a public resource that will be maintained alongside the current HTML format for all NRPM versions going forward.

The repository contains a single Markdown file with a commit history spanning all 46 NRPM iterations and a user-friendly web interface for viewing differences between versions.

It’s also available via standard Git commands for those familiar with using Git for code and documentation repositories.

Join Us For Lunch!

Representatives from our customer organizations in the Indianapolis and Chicago areas are invited to join us for our newest initiative, ARIN Lunch by the Numbers.

These lunches are specifically tailored to our customer organizations who may not have much visibility into the inner workings of ARIN. During lunch, our staff will present you with an informal overview of our current activities and services. Afterward, there will be plenty of time for questions and for you, our valued community members, to provide us with feedback. We will have a Registration Services Help Desk at each event, so please bring any specific questions about your resources.

Registration is free and is now open for both events:

ARIN Lunch by the Numbers: Indianapolis
Tuesday, 30 October 2018
11:45 AM to 2:00 PM

ARIN Lunch by the Numbers: Chicago
Wednesday, 31 October 2018
11:45 AM to 2:00 PM

In September we added a few new features to ARIN Online:

  • We completed a number of infrastructure improvements and performed multiple bug fixes.
  • Whois now provides an error response when it receives a forward domain query that does not include qualifiers or flags.
  • Changes were made in our system to improve the speed of network and ASN transfers.
  • RPKI now allows input and certification of Direct Assignment (DS) and Direct Allocation (DA) resources that are under Early Registration Transfer (ERX) Project space as well as DS and DA resources that are top legacy networks.
  • For RDAP queries on the Origin AS field, the results are limited to 256 networks.

Join us for Industry events this fall:

This fall, we’ll be participating in events across our region, including WISPAPALOOZA, Internet2 Technology Exchange, EDUCAUSE, the Canadian ISP Summit and more. We’ll be discussing topics like IPv6, transfers, updating info in Whois, and more. Stop by and see us if you plan to be there. See TeamARIN for more details.

Our Featured Policy Requirement:

Did you know that under section 5 of NRPM, you can request an Autonomous System number (AS Number) from ARIN even if you don’t have IPv4 or IPv6 addresses directly registered with ARIN? You can use an ARIN issued AS number for use with IPv4 or IPv6 addresses which have been issued by your Internet Service Provider.

A Tip from ARIN’s Registration Services Department

A ticket cannot be re-opened once it has closed. All tickets in ARIN Online close after three months of inactivity. A notification that your ticket will auto-close is sent 15 days prior to closure. To keep the ticket open, simply reply to the ticket, and the auto-close clock will reset. If you did not intend to let a ticket close, you must submit a new ticket. In the new ticket, reference the ticket number for the ticket that closed. If any utilization or other time sensitive information was provided in the previous ticket, you may want to include updated current information in the new ticket.

Check out these Customer and Member Statistics (As of 31 August 2018)

  • 5,851 member organizations
  • 604 8.3 transfers and 103 8.4 transfers completed YTD 2018
  • 8.4 transfers completed YTD 2018: 50 to APNIC, 7 from APNIC, 41 to RIPE NCC, 5 from RIPE NCC
  • 58.1% of members have an IPv6 block

Helpful IPv6 Links

Catch Up on Our Recent Posts:

The post ARIN Bits: September 2018 appeared first on Team ARIN.

Read more here:: teamarin.net/feed/

Network complexity, 5G rollouts will drive SON (Self-Organising Network) spending to $5.5 bn, says SNS Telecom & IT

Posted on by News Aggregator

By Anasia D’mello

SNS Telecom & IT‘s latest research report indicates that the growing complexity of mobile networks and 5G NR (New Radio) infrastructure rollouts will drive SON (Self-Organising Network) spending to $5.5 Billion (€4.69 billion) by 2022.

SON technology minimises the lifecycle cost of running a mobile network by eliminating manual configuration of network elements at the time of deployment, right through to dynamic optimisation and troubleshooting during operation. Besides improving network performance and customer experience, SON can significantly reduce the cost of mobile operator services, improving the OpEx-to-revenue ratio and deferring avoidable CapEx.

To support their LTE and HetNet deployments, early adopters of SON have already witnessed a spate of benefits – in the form of accelerated rollout times, simplified network upgrades, fewer dropped calls, improved call setup success rates, higher end-user throughput, alleviation of congestion during special events, increased subscriber satisfaction and loyalty, and operational efficiencies – such as energy and cost savings, and freeing up radio engineers from repetitive manual tasks.

Although SON was originally developed as an operational approach to streamline cellular RAN (Radio Access Network) deployment and optimisation, mobile operators and vendors are increasingly focusing on integrating new capabilities such as self-protection against digital security threats, and self-learning through artificial intelligence techniques, as well as extending the scope of SON beyond the RAN to include both mobile core and transport network segments – which will be critical to address 5G requirements such as end-to-end network slicing. In addition, dedicated SON solutions for Wi-Fi and other access technologies have also emerged, to simplify wireless networking in home and enterprise environments.

Largely driven by the increasing complexity of today’s multi-RAN mobile networks – including network densification and spectrum heterogeneity, as well as 5G NR infrastructure rollouts, global investments in SON technology are expected to grow at a CAGR of approximately 11% between 2019 and 2022. By the end of 2022, SNS Telecom & IT estimates that SON will account for a market worth $5.5 Billion (€4.69 billion).

The “SON (Self-Organising Networks) in the 5G Era: 2019 – 2030 – Opportunities, Challenges, Strategies & Forecasts” report presents an in-depth assessment of the SON and associated mobile network optimisation ecosystem, including market drivers, challenges, enabling technologies, functional areas, use cases, key trends, standardisation, regulatory landscape, mobile operator case studies, opportunities, future roadmap, value chain, ecosystem player profiles and strategies. The report also presents revenue forecasts for both SON and conventional mobile network optimisation, along with individual projections for 10 SON submarkets, and 6 regions from 2019 till 2030.

The report will be of value to current and future potential investors into the SON and wider mobile network optimisation ecosystem, as well as SON solution providers, LTE/5G network infrastructure OEMs, enabling technology providers, mobile operators and other ecosystem players who wish to broaden their knowledge of the ecosystem.

For further information concerning the SNS Telecom & IT publication, click here

Comment on this article below or via Twitter: @IoTNow_OR @jcIoTnow

The post Network complexity, 5G rollouts will drive SON (Self-Organising Network) spending to $5.5 bn, says SNS Telecom & IT appeared first on IoT Now – How to run an IoT enabled business.

Read more here:: www.m2mnow.biz/feed/