product visualization using augmented reality, Papers of Computer Science

Download product visualization using augmented reality and more Papers Computer Science in PDF only on Docsity! PRODUCT VISUALIZATION USING AUGMENTED REALITY 2020-2021 CHAPTER 1 INTRODUCTION 1.1 Introduction To Augmented Reality Augmented Reality (AR) is defined as a direct or indirect view of a physical, real-world environment whose elements are augmented by computer-generated sensory input. Simply put, AR is digital content onto a live camera feed which makes it a part of the physical world. 1.Trigger based: They are stimuli that initiate the augmentation. They can be papers, object markers as well as GPS locations. 2.View based: These digitized objects do not require a reference field to be overlaid, where their location can be manipulated dynamically. 1.2 Types Of Augmented Reality 1.2.1 Marker-Based Augmented Reality The other name for Marker-Based AR is also called Image Recognition or Recognition based AR. This type of AR provides us more information about the object after It focuses on the recognition of objects. Marker-based AR technology has diverse uses according to market purposes. It detects the object in front of the camera and provides information about the object on the screen. The recognition of the object is based on the marker where it replaces the marker on the screen with a 3D version of the corresponding object. Therefore, the user can view the object in more detail and from various angles. Apart from that while rotating the marker user can also rotate the 3D imagery as well. This acts as a reference for the AR app running on the system. 1.2.2 Marker-less Augmented Reality Marker-less augmented reality is one of the most widely implemented applications in the industry. It is also known as Location-based AR for the reason for the easy availability of the features in the smartphones that provide location detection. This type of app is mostly used to help travellers. Apart from that, it helps users to discover interesting SS Dept of ISE RIT, Hassan Page 1 PRODUCT VISUALIZATION USING AUGMENTED REALITY 2020-2021 places within their current location. This method works by reading data from the mobile’s GPS, digital compass and accelerometer while predicting where the user is focusing. This AR is all about adding location information on screen about the objects that can be seen from the user’s camera. 1.2.3 Projection Augmented Reality This is one of the simplest types of AR which is the projection of light on a surface. Projection-based AR is appealing and interactive where light is blown onto a surface and the interaction is done by touching the projected surface with hand. The widespread uses of projection-based AR techniques can be used to create deception about the position, orientation, and depth of an object. In such a case this allows the user to take different objects into consideration and its structure in order to study in-depth. This technology offers a whole lot more in every sense. This piece of tech is used for creating a virtual object for much larger deployments for experiencing Augmented Reality. 1.2.4 Superimposition Based Augmented Reality As the word itself explains the superimposition of the objects. This AR provides a replacement view of the object in focus. This is done by replacing the entire or partial view with an augmented view of the object. Here object recognition plays a vital role where replacing a view of an object with an augmented view is done. Among the above four types application used marker-less AR due to the fact that it suits the requirements of the project. 1.3 Advantages Of Augmented Reality The primary benefit of Augmented Reality is that it can be used by anyone including mentally and physically disabled individuals. It blurs the line of difference between the virtual and real world, thus increasing its usability and effectiveness in the area of application. It possesses a highly interactive nature which enable to assess several instances in advance. Success or failure of an instance can be determined by using the computing power of AR, thus saving a ton of money. It finds its heavy usage in the field of health, thus increasing the accuracy of diagnosis for diseases. Since now, it has saved lives of numerous patients. SS Dept of ISE RIT, Hassan Page 2 PRODUCT VISUALIZATION USING AUGMENTED REALITY 2020-2021 PROBLEM STATEMENT 2.1 Existing System The existing systems are online furniture websites which only let us view the pictures of the product and their dimension. These details about the product are not sufficient enough to make a decision whether to buy the product or not. Even if the user purchases the product the user might not like it in person or it might not look good when it is places in real environment. There are fewer chances that the user might like the product in person if he/she orders the product by given details. To return the product takes a lot of time as some items are heavy such as sofas, beds and so on. The most commonly used ones are as follows: e IKEA Place IKEA is leading the furniture industry. IKEA’s furniture categories within the App have not expanded to its full lists, meaning you can only view a few items if you want to purchase from IKEA. On the other hand, the app user experience is the best so far, in terms of UI and quality of their 3D models. Advantages: > High fidelity 3D models, great UX experience Disadvantages: > Limited product selection e Homestyler If you take a photo of your room, the app has the ability to convert it into a 3D scene where you can place 3D models into your picture offline. Homestyler product selections are very limited and usually from non-popular brands. Homestyler is more like a fun product for designers, since shoppers won’t want to buy furniture from the platform. Advantages: > Products are 3D models therefore making design easier from any angle. Disadvantages: > Bad User Interface. SS Dept of ISE RIT, Hassan Page 5 PRODUCT VISUALIZATION USING AUGMENTED REALITY 2020-2021 ¢ DecorMatters The app has a few 3D models for users who want to try furniture in 3D, but their main focus is still on 2D. It can upload your own furniture and decorations, and place it on a template or a picture of your room. This app has few 3d models, and it does not always satisfies the user. Advantages: > It is best for users who design their room by themselves. Disadvantages: > Few 3D models to shop. 2.2 Proposed System The basic idea behind the app is that the user can visualize the product by placing it in an open space; this is achieved by Augmented Reality, a technology which is very rapidly growing in the market. Industries like gaming, movies, entertainment are booming rapidly by incorporating Augmented Reality in their products. It will help the customer choose the product which they want to buy and then place it in the given room of an unknown dimension. The application aims to augment products of a large variety such as Dining Table, Sofa Set, Chairs, Flower Vase, Small Coffee Table and so on. The 3D models then could be placed in the room by tapping on the screen of the phone and see where it would suit the best according to the customer’s choice. The main motive behind this app is the comfort of the user and increasing the ease of online shopping by the use ofAugmented Reality. The user will easily be able to browse through different products based on generic classification and then choose the desired option and check it in augmented reality. The User Interface is a simple app and very user friendly by just tapping and dropping the product and also moving it around the room. SS Dept of ISE RIT, Hassan Page 6 PRODUCT VISUALIZATION USING AUGMENTED REALITY 2020-2021 CHAPTER 3 SYSTEM DESIGN Systems design is the process of defining the architecture, modules, interfaces,and data for a system to satisfy specified requirements. Systems design could be see as the application of systems theory to product development. There is some overlap with thedisciplines of systems analysis, systems architecture and systems engineering. 3.1 Seller Model Fig 3.1 : Flowchart of seller model. SS Dept of ISE RIT, Hassan Page 7 PRODUCT VISUALIZATION USING AUGMENTED REALITY 2020-2021 ST 3.2.3.4 Generate Strong Rules Generate strong rules from frequent itemset .Strong Rules are rules which satisfy the minimum support and minimum confidence threshold. 3.4 Database For the backend technology, we will use a NoSQL database. This database will hold the information about furniture item and its various attributes. When the application basic information about some item. It will also store user data. PRODUCT VISUALIZATION USING AUGMENTED REALITY 2020-2021 ST CHAPTER 4 WORKING OF THE APPLICATION BDeplay AR oatent Processor Smartphone screen Display Devices Camera Input Devices Gps IMU ee SRequest Web Server ‘Virtual a Ris Cloud Server Objects Fig 4.0:- Working of the Application Blender creates 3D models of the virtual object. The format for the 3D models is .OBJ format. Once created, these models are can we used in the application. ARCore takes in as input, the digital signals from the phone’s primary camera and the sensors. The camera supplies the image feed to ARCore. From the set of images, the ARCore Engine creates a virtual representation of the world. Various sensors from the smart phone like accelerometer, gyroscope, Ambient Light Sensor and GPS are used to calibrate ARCore and help understand how the camera is placed and being moved, in the virtual environment. The user has the choice to selects a furniture item from the catalog or suggestions list. After selecting, he needs to tap on the image to place it on the virtual environment. The 3D model of that item needs to be fetched from the application, in order to be overlaid. PRODUCT VISUALIZATION USING AUGMENTED REALITY 2020-2021 ST The 3D model is received by the application. Then ARCore identifies possible surfaces by performing the hit test. When a surface is identified, the 3D model is appropriately rendered onto the surface. This gives a Pose to the object and it is successfully anchored to that plane. The rendered model of the 3D furniture is combined with the camera feed to create a realistic scene view. The AR Content based on the orientation of the user, is overlaid on the camera feed. This is sent to the application to be displayed on the window. PRODUCT VISUALIZATION USING AUGMENTED REALITY 2020-2021 ST CONCLUSION The primary motive for developing this project is to enable furniture shoppers to experience how the products will look in their room, and to enable better purchases. Our project made it possible to visualize the product which a user wants to buy in real world using Augmented Reality. User was be able to place multiple products and design the entire room. Using association mining user are able to check suggested products which go well with other products selected by them. The basic features for a shopping app which are signup, login, cart, placing an order and so on were included in the application. REFERENCES SS Dept of ISE RIT, Hassan Page 15 PRODUCT VISUALIZATION USING AUGMENTED REALITY 2020-2021 ST [1] Charanjeet K. (2013), “Association Rule Mining using Apriori Algorithm: A Survey”, International Journal of Advanced Research in Computer Engineering & Technology, Vol. 2, Issue 6 [2] ARCore and ARKit Platforms for AR/VR Applications”, Available at: https://www.researchgate.net/publication/3330390 77. [3] Dhiraj A. and Sharvari G. (2016), “Comparative Study of Augmented Reality SDKs”, Available at: https:// www.researchgate.net/publication/276855764. [4] Mrs Ruchita T., Vikas P., Sourabh K., Lalit M. and Nikhil L. (2019), “Furnishing Using Augmented Reality’, IOSR Journal of Computer Engineering, Vol. 21, Issue 3, Ser. III, pp. 68-72. [5] Ananda P. and Omar A. (2018), “Interior Design with Augmented Reality”, Department of Computer Science and Information Technology, Saint Cloud State University. SS Dept of ISE RIT, Hassan Page 16