-
- [White Papers] A New Standard for Video Quality Assessment, VQML
- .center-table { margin-left: auto; margin-right: auto; border-collapse: collapse; } ContentsNecessity of VQMLWhat is VQML? Techniques in VQMLLearning & Evaluation Process of VQMLVersus Umetrix VideoInput & Output Value Dataset Utilized in VQMLOutstanding Points of VQMLHigh Performance of VQMLVerify Reliability of VQMLNecessity of VQMLThe mobile network market is growing explosively due to the rapid growth of 4G and 5G subscribers and the expansion of service coverage. According to the Ericsson Mobility Report in November 2020, 5G subscribers are expected to exceed 3.5 billion by the end of 2026.In this situation, the growth of mobile video services is no surprise. Figure 1 shows the traffic volume of mobile data by media measured by BI Intelligence. In 2020, video services account for about 75% of the total mobile data usage. Combined with the growth of 5G and the COVID-19 situation we are facing today, this number will grow even more and mobile network operators should be prepared for it.Figure 1. Mobile data traffic usage by mediaThe performance and quality of the video services that users experience are critical aspects of the network operations. In live-streaming services that transmit video over the network in real-time, videos may not be completely transmitted due to various loss issues in the network. This may result in different qualities of received videos between consumers. To prevent such situation, we need to find a way to accurately measure the video quality in real-time and ensure consistence in good quality of video transmission on mobile networks.Innowireless’ VQML is introduced as a deep learning-based, high-level video quality assessment solution. Compared to other traditional evaluation methods, VQML is distinguished as a better solution due to its faster processing speed, cheaper implementation and no need for original reference video.As a new way to measure video quality, VQML lets mobile and broadband network operators meet customer expectations and needs with optimized network operation.What is VQML? The simplest way to measure the quality of a video is to obtain the MOS (Mean Opinion Score) using human judgements. This is also the most accurate way, but it requires too many people and too much time and cannot be proceeded in real-time.In order to resolve these time and cost problems, VQML takes high volume of video data and continuously trains a neural network to predict the video quality score as accurately as the human judgements. Using deep learning, VQML learns patterns of videos and MOS values from a database derived from viewers’ large-scale surveys.VQML predicts the quality of the video as a MOS value within a range of 1 and 5 which corresponds to the actual human perception.The meaning of each score is as follows. Score Quality Perception 5 Excellent 4 Good 3 Fair 2 Poor 1 Bad Figure 3. Video quality assessment in VQMLTechniques in VQMLMethods for Video Quality Assessment (VQA) include Full Reference (FR), Reduced Reference (RR), and No Reference (NR). Figure 4. Video Quality Assessment SolutionsFR, which is currently used by most products, evaluates the quality by comparing the original video with the received video. Although it shows high reliability due to direct comparison between videos, it is difficult for the client to have the original video. It is also difficult to be used on platforms where videos are created and serviced in real-time.For this reason, FR method is not a suitable solution due to its limitations especially in current situations where live-streaming services are commercialized, and video conferences and classes are increasing due to the Covid-19. VQML operates based on the NR method that measures quality only with the received video. Without the need for the original video, NR method can calculate the quality metric of any video in real-time and effectively assess the video quality in areas where FR methods are difficult to apply.Some well-known areas where NR methods are ideal quality assessment tools are CCTV and real-time video platforms. These areas can utilize the NR method to measure the actual perceived quality by identifying all the degradation factors on their own video without a comparison video.NR method mostly measures quality by extracting statistical characteristics of the video with mathematical algorithms. It works based on the KPI designed by researchers, so it may result in large average error compared to the actual quality score perceived by humans.VQML uses large-scale and highly reliable database to repeatedly train itself to continuously improve its prediction of video quality score in order to compensate for the limitations of the NR method.Learning & Evaluation Process of VQMLThe training of VQML uses the KoNViD-1k and YouTube-UGC datasets. The KoNViD-1k dataset is a large database consisting of MOS collected from over 1,000 videos and dozens of viewers. The YouTube-UGC dataset refers to a video database with 4K UHD characteristics. VQML’s deep learning network consists of 2 CNN modules and 1 GRU module.Figure 5. Learning Process of VQMLWhen a video sample from the learning dataset is input into the model, the CNN module processes each frame and the GRU module follows to analyze the sequence of consecutive frames in order to recognize the pattern of the features of the video sample. The extracted features are used to finally predict the quality of the video.After the measurement result comes out, calculate the difference from the actual MOS and modify the deep learning network to reduce this error. By repeating this process, the deep learning network learns to measure the quality value of that video with minimal error.After enough training, VQML can predict a video quality score that is very close to the actual MOS value.Versus Umetrix Video Another NR method solution for predicting video quality is Spirent’s Umetrix Video.Unlike VQML, which uses deep learning, Umetrix Video operates based on a variant of the image quality assessment model of BRISQUE (Blind Reference-less Image Spatial Quality Evaluator).The performance of VQML is evaluated by its predicted score’s correlation with the actual viewer’s MOS. Since Umetrix Video doesn’t provide the corresponding performance metric, it is difficult to directly compare the performance of the two. But BRISQUE and deep learning algorithm can be used to indirectly compare their performances.Figure 6 shows the degree of correlation BRISQUE and deep learning algorithms have with MOS in the academically published dataset (KoNViD-1k, LIVE-VQC, YouTube-UGC). Items Umetrix Video VQML KoNViD-1k 65.67 % 80.18 % LIVE-Qualcomm 70.90 % 89.26 % LIVE-VQC 72.76 % 89.16 % YouTube-UGC 69.57 % 87.61 % Figure 6. Correlation between MOS and each algorithm within a public dataset(Source : UGC-VQA: Benchmarking Blind Video Quality Assessment for User Generated Content, Zhengzhong Tu et.al., arXiv:2005.14354)The BRISQUE algorithm shows a value of about 38.2 to 65.7%. Considering that Umetrix Video is a variant of BRSIQUE, it is presumed to have a similar value, so VQML with a correlation of about 71.83 to 80.18% would show better performance.Currently, the only performance evaluation method opened to the public for Umetrix Video is correlation with VMAF which is developed by Netflix and the University of Southern California.The graph below shows the score distribution of VMAF learning dataset used by Umetrix Video. We can see that a lot of data are distributed at scores close to 100 due to the nature of VMAF, which produces 100 points if the original and reference videos are the same. Umetrix Video behaves very similar to VMAF with correlation coefficient as high as 80%. Umetrix Video and VMAF both focus on whether the reference video is the same as the original, whether there was no distortion in the communication process, rather than the video quality perceived by humans.Features of VQML and Umetrix Video are compared in the following table. SROCC (%) BRISQUE DL-based VQA Architecture BRISQUE + SVMCNN + GRUDL-basedNY Number of used properties36* Properties of BRISQUE2048 GPU-acceleratedNY MOS correlationN/AAbove 80% VQA methodAverage value of image qualityGRU-based Time series AI predictionParallel process(Simultaneous prediction)NY Mobile-friendlyLowHigh Resolution limit1 fixed resolution by model None Figure 8. Features and differences between VQML and Umetrix VideoFirst, there is a difference in how VQA is performed to measure the MOS of the video. Umetrix Video obtains the quality of one frame and averages it over time to obtain the quality value of the video.VQML, on the other hand, utilizes GRU within the neural network structure in order to analyze the relationship between the series of frames through time dimension. Therefore, VQML can predict a MOS value that is closer to the actual MOS value of a video watched by a person.VQML also enables hardware accelerating through GPU, but Umetrix Video is based on machine learning algorithms with limited parallel processing applications, making GPU acceleration difficult.In addition, unlike VQML which provides a lightweight version that can predict video quality score in a mobile device, Umetrix Video is known to lack a lightweight version for mobile applications.Input & Output ValueVQML only requires the video itself to predict the video quality score. When the video is input into the VQML neural network, VQML automatically decodes it and converts it into frames, which are sets of pixel values expressed in RGB, and extracts features from the frames to compute the quality score of the video as the output of the model. VQML can execute this process in speed that is close to real-time.By default, the quality score of the video is output after the entire video is processed through VQML. There is an option provided to adjust the video viewing time in order to predict the quality score for specific segments within the video.Dataset Utilized in VQMLDeep learning method has recently been applied to various applications. A highly acknowledged database is required to ensure reliable performance of such deep learning-based solutions.The KoNViD-1k database (http://database.mmsp-kn.de/konvid-1k-database.html) used for VQML’s learning is a highly reliable database consisting of 1,200 videos evaluated by more than 100 people. It has been cited more than 130 times in papers around the world since the VQA group at the University of Konstanz, Germany, published it at the IEEE QoMEX 2017 academic conference, and is widely accepted by academia as a database for video quality assessment.Another learning database, the YouTube-UGC dataset, contains user-generated content collected from YouTube, providing videos of different resolutions and formats. Some of them have 4K UHD (Ultra High Definition) characteristics, which are useful resources for research and development activities and are widely sed for quality evaluation and content classification.The KoNViD-150k database (http://database.mmsp-kn.de/konvid-150k-vqa-database.html), released in 2021, also consist of KoNViD-150k-A set (152,265 videos evaluated by 5 people) and KoNViD-150k-B set (1,577 videos evaluated by more than 89 people), ensuring high reliability. The VQA group at the University of Konstanz says this database can be used for efficient video quality tests. Besides the training datasets from KoNViD-1k, VQML utilizes the KoNViD-150k-B set database for objective performance testing.This allows the deep learning network in VQML to have high accuracy and perform video quality prediction that reflect patterns in real-world communication environment.Outstanding Points of VQMLVQML is also unique in the configuration of deep learning networks.VQA solutions based on deep learning often include transfer learning using pre-trained CNN modules.Most solutions utilize a pretrained CNN module followed by a recurrent module such as a LSTM or GRU module. In such structure, the CNN module is pre-trained using the Image Net database (https://www.image-net.org/download.php) consisting of more than 1 million images built by Professor Li-Fei-Fei at Stanford University. The model’s learning process based on the training database only occurs throughout the following recurrent module.In contrast, VQML consists of 2 CNN modules and 1 GRU module. Each CNN module is pre-trained with the ImageNet database and the KonIQ-10k database (http://database.mmsp-kn.de/koniq-10k-database.html) which is a set of over 10,000 images produced by the VQA group of the Konstanz University. Then a GRU module continues to train the model with the features extracted from the 2 previous CNN modules. So the actual learning based on the training data occurs through all 3 modules. In order to mimic a unique characteristic of the human visual system, a temporal pooling layer is added. This layer takes into account how humans perceive an instant degradation in video quality due to a sudden drop in the streamed video much greater than it actually is, and result in a stronger degradation in overall video quality.In conclusion, VQML is able to extract highly detailed contextual as well as temporal characteristics of the assessed videos better than the other VQA solutions.High Performance of VQMLFigure 9 is a verification graph of VQML’s performance based on the KoNViD-1k dataset.Figure 9. Correlation with Ref-MOS and VQMLThis is the correlation between the actual viewers’ MOS and the quality score predicted by VQML. The measurement results are very close to the actual MOS values forming almost a straight line. The graph shows a correlation of about 86.5%, which proves the VQML is a reliable solution.Also, the MAE (Mean Absolute Error) of VQML is 0.235, which is smaller than the average MAE of other products currently commercially available. This means that the output of VQML’s prediction can be as accurate as the human perception on judging the quality of the Video.Verify Reliability of VQMLTo verify the reliability of VQML, tests were conducted using various types of videos. Each video has its own characteristics that represent the video quality in a specific environment. TypeFeatureDramaGeneral screenMovieRelatively dark screenSports Lots of movement and bright lightAnimation Artificial color that stands out Figure 10. Video types and features used in tests After distorting the indicators of each video into several units using the FFmpeg codec, the MOS value of the video to which the distorted indicators were applied was measured. Blockiness Option Change the degree of block generation by adjusting the bitrate with b:v option Unit 10000k / 5000k / 1000k / 500k / 300k/ 200k / 100k BlurOptionUse the boxblur option to adjust the degree of blur in the videoUnit0.0 / 2.5 / 5.0 / 7.5 / 10.0 / 20.0 / 30.0 BrightnessOptionChange brightness by adjusting brightness option of Eq AVOptionsUnit-1.0 / -0.75 / -0.5 / -0.25 / 0 / 0.25 / 0.5 / 0.75 / 1.0 ColorfulnessOptionColor distortion by adjusting the saturation option of Eq AVOptionsUnit0.0 / 0.5 / 1.0 / 1.5 / 2.0 / 2.5 / 3.0ResolutionOptionChange the resolution with the scale optionUnit2160p / 1440p / 1080p / 720p / 480p / 360p / 240p / 144pFigure 11. Encoding options, units and examples applied to video indicatorsThe measurements made using the VQML algorithm are as follows. ?Blockiness : The higher the bitrate, the higher the MOS value.?Blur : The cleaner the video, the higher the MOS value.?Brightness : The lower the brightness, the lower the MOS value. ?Colorfulness : The lower or higher the color distortion intensity, the lower the MOS value. ?Contrast : The lower the contrast, the lower the MOS value. ?Resolution : The higher the resolution, the higher the MOS value. Figure 12. MOS value measurement results for distorted indicator-specific videoColorfulnessOptionColor distortion by adjusting the saturation option of Eq AVOptionsUnit0.0 / 0.5 / 1.0 / 1.5 / 2.0 / 2.5 / 3.0ContrastOptionChange the contrast by adjusting the contrast option of Eq AVOptionsUnit0.0 / 0.5 / 1.0 / 1.5 / 2.0 / 2.5 / 3.0ContrastOptionChange the resolution with the scale optionUnit2160p / 1440p / 1080p / 720p / 480p / 360p / 240p / 144pFigure 11. Encoding options, units and examples applied to video indicatorsThe measurements made using the VQML algorithm are as follows.Blockiness : The higher the bitrate, the higher the MOS value.Blur : The cleaner the video, the higher the MOS value.Brightness : The lower the brightness, the lower the MOS value. Colorfulness : The lower or higher the color distortion intensity, the lower the MOS value. Contrast : The lower the contrast, the lower the MOS value. Resolution : The higher the resolution, the higher the MOS value. Figure 12. MOS value measurement results for distorted indicator-specific videoWhen the MOS value according to the change of each encoding option was compared with the original video, the original recorded the highest score. In other words, as the degree of distortion increases, the video quality decreases, and the MOS value measured by VQML tends to decrease.These results are interpreted as important indicators showing that VQML is a reliable tool for video quality evaluation. As such, VQML, an original video quality assessment solution unique to Innowireless, is expected to be sufficiently competitive in the market.
May 17, 2024
-
- KCA′s Private 5G Site Regulating with XCAT-IXA and XCAL-AIR
- As businesses across industries embrace digital transformation and seek enhanced connectivity, private 5G networks are emerging as a powerful solution to address their unique needs. The current market size of Private 5G networks is projected to witness a remarkable growth trajectory, with a CAGR of 42.3% to 51.2% expected until 2030. Private 5G networks offer enhanced security, ultra-low latency, and guaranteed bandwidth, making them ideal for mission-critical applications in industries such as manufacturing, healthcare, and transportation. Unlike public networks, private 5G networks can be customized to align precisely with specific business requirements and use cases, optimizing resource allocation and performance.The convergence of private 5G with IoT devices, edge computing, and AI is unlocking unprecedented possibilities for automation, real-time data analytics, and predictive maintenance. [Regulatory Landscape of Private 5G in Korea] Regulatory frameworks for Private 5G networks vary across regions. Within KCA\'s multifaceted role in shaping the Korean private 5G market, \"Developing regulations and guidelines\" serves as a critical cornerstone. Key areas of regulation- Spectrum allocation: KCA defines how the limited radio spectrum is allocated for private 5G networks. This involves establishing licensing procedures, determining eligibility criteria for different types of users, and setting spectrum usage fees.- Technical standards: KCA sets technical standards for network equipment, software, and services to ensure compatibility, interoperability, and network security. This includes defining minimum performance requirements, data encryption protocols, and network management procedures.- Security and privacy: KCA establishes robust security and privacy regulations to protect sensitive data within private 5G networks. This includes data breach notification requirements, user authentication protocols, and data retention policies.- Quality of service (QoS): KCA defines minimum QoS requirements for private 5G networks to ensure reliable and consistent connectivity for critical applications. This involves setting metrics for latency, bandwidth, and packet loss.- Interference prevention: KCA takes measures to prevent interference between private 5G networks and public networks or other radio services. This may involve setting geographic separation requirements or defining power limits for network transmissions. [Accuver and KCA Collaborate to Pave the Way for Private 5G Networks]Private 5G networks are booming in smart factories, but signal interference between nearby businesses can be a problem. To ensure smooth operation and regulatory compliance, KCA (Korea Communications Agency) needed a solution for on-site inspections. Their plan consisted of three key parts:- Building a database: This database would store inspection results and statuses for different scenarios, helping KCA track compliance and identify potential issues.- Developing a dedicated inspection program: KCA wanted a program specifically designed for private 5G networks, including wireless station verification and signal strength/interference measurements.- Defining evaluation criteria: Clear standards were needed to assess the results of inspections and ensure consistent enforcement.To tackle this challenge, KCA partnered with Accuver, a technology company specializing in network testing solutions. Together, they created a comprehensive inspection protocol in 2023:Wireless station verification: Accuver\'s portable analyzer (XCAT-IXA) verified the proper configuration of network equipment.Indoor/outdoor signal measurements: XCAT-IXA was used for walking measurements, both inside and outside buildings, to assess signal strength and coverage. Outdoor interference in high-rise buildings: For scenarios where walking measurements weren\'t feasible, Accuver used a drone-based solution (XCAL-Air) in conjunction with XCAT-IXA to measure interference levels more effectively.After six months of collaboration, the efficient inspection program is ready. KCA will now report it to the Korean Ministry of Science and ICT for approval. This new program will help ensure responsible development and efficient operation of private 5G networks in Korea, ultimately benefiting businesses and consumers alike. [XCAL-Air for Outdoor interference measurement] XCAL-Air is a powerful, integrated drone-based package specifically designed for measuring and analyzing performance in airspace networks. This advanced solution combines various network equipment, including spectrum analyzers, scanners, and mobile network measurement devices, boasting a comprehensive feature set for efficient network verification in airspace environments. Thanks to Accuver\'s innovative tools, KCA can obtain precise 5G signal strengthmeasurements in the air. XCAT-IXA spectrum analyzer checks signal strength and transmits the data to the cloud. This enables them to view real-time signal strength, such as RSRP from Private 5G cells, on a 3D map, making it easy to identify any weak spots or interference. According to KCA rules, areas with an RSRP stronger than -115dBm outside the designated zone require adjustment. In the future, KCA plans to create a database of on-site inspection data for private 5G sites and manage it continuously for supervision. [Conclusion]The convergence of Private 5G with IoT devices, edge computing, and AI opens unprecedented possibilities for automation, real-time data analytics, and predictive maintenance. The role of entities like the Korea Communications Commission (KCA) becomes crucial in shaping regulations and guidelines to facilitate the seamless integration of private 5G networks.Accuver\'s collaboration with KCA showcases a proactive approach to addressing challenges in private 5G deployment. By developing a comprehensive on-site inspection protocol, including wireless station verification, signal strength/interference measurements, and interference prevention, the collaboration ensures smooth operation, regulatory compliance, and efficient management of private 5G networks in smart factories. The introduction of XCAL-Air as a drone-based solution for outdoor interference measurement further enhances the capability to identify and resolve coverage in airspace networks. Accuver\'s innovative tools, such as the XCAT-IXA spectrum analyzer, enable precise 5G signal strength measurements. The integration of these tools aligns with KCA\'s objective to create a database of on-site inspection data for continuous supervision and management of private 5G sites. Cooperation between Accuver and KCA to revitalize the private 5G Network market will continue.Accuver plans to continue developing solutions for two key markets: regulatory agencies, like the FCC and Ofcom, who require private 5G on-site inspections (similar to KCA), and engineering companies who need private 5G completion inspections.
Jan 23, 2024
-
- Streamline the O-RAN IOT badge compliant test with AEGIS-O
- [O-RAN Certification and Badging Program] The O-RAN certification and badging program aims to minimize repetition of fundamental and common tests performed to verify and validate O-RAN based products and solutions before their deployment in operator networks. It defines and unifies processes, procedures, templates, data format, etc. which are provided to ensure sharing of the test results and repeatability of the executed tests. Currently, the O-RAN certificates, IOT badges and E2E badges have been defined for the following products (and interfaces). ● O-RAN certificates for- O-RU with Open Fronthaul interface (WG4)- O-DU (or combined O-DU/O-CU) with Open Fronthaul interface (WG4) ● O-RAN IOT badges for- O-RU and O-DU (or combined O-DU/O-CU) connected via Open Fronthaul interface(WG4)- eNB and en-gNB connected via X2 interface(WG5) - gNB-DU and gNB-CU connected via F1-C interface(WG5) - two gNBs connected via Xn-C interface (WG5)● O-RAN E2E badges for -O-RU, O-DU and O-CU (or their combinations) included in the E2E system or subsystem(TIFG)The O-RAN certification and badging refers to tests defined in O-RAN test specifications produced by related O-RAN Work/Focus Groups. Through O-RAN certification and badging program, any O-RAN vendor regardless of their size can have an opportunity to showcase their products and solutions, improve interoperability, and ultimately increase vendor diversity and supply chain resilience for operators embracing open RAN.O-RAN certification and badging can improve operator confidence in their chosen O-RAN based blueprint and can reduce the complexity and duration of pre-deployment testing.[AEGIS-O supports Automated Test and Report Development for O-RAN IOT Badging(WG5)] AEGIS-O introduces a new feature that provides automated testing functionality for O-RAN IOT badges, encompassing all test cases defined in the O-RAN Open F1/X2/Xn Interface, as outlined by the Interoperability Test Specification of the O-RAN Alliance Working Group (WG5). Operators can easily examine the compatibility of multi-vendor systems based on the O-RAN Test Specification and precisely analyze interoperability problems. Accuver (Innowireless) is an active member of the O-RAN Alliance. AEGIS-O was developed to automatically perform and report the same tests conducted by OTIC. Operators and vendors can independently conduct the same level of interoperability tests as OTIC using AEGIS-O. AEGIS-O not only executes tests defined in the IOT Badge specification but also provides features to analyze each test case in detail, such as the Packet Viewer, CDR Viewer, and Detail Report. Users can access statistical information about all test cases and investigate each test case for troubleshooting. This helps both operator and vendor communities prepare for OTIC tests and ensures confidence in O-RAN based products and solutions. Vendors can enhance interoperability and prepare for OTIC certification tests by proactively preparing the test cases defined in the standard. By conducting tests with AEGIS-O, operators can ensure interoperability at the OTIC level when configuring systems with products from different vendors. This reduces testing efforts for network operators and promotes vendors\' O-RAN based products and solutions, creating an opportunity for interoperability among different vendors and gaining acceptance from others. [AEGIS-O O-RAN IOT Badging( WG5) Test Procedure] AEGIS-O provides an automated testing feature for eNB and gNB connected via the X2 interface, gNB-DU and gNB-CU connected via the F1-C interface, and two gNBs connected via the Xn-C interface. It supports all the test cases specified in the O-RAN Open F1/X2/Xn Interface Working Group Interoperability Test Specification. In AEGIS-O, once the user selects the interface and test case and initiates the test, the results are assessed according to the criteria established within the O-RAN ALLIANCE framework. AEGIS-O offers Badge Reports that present the test results, and users can comprehensively investigate individual test cases using tools such as the Packet Viewer, CDR Viewer, and Detail Report. Midhaul traffic is tapped and flow into AEGSI-O by capture card and Packet Broker. When the user clicks WG5.IOT on the menu screen of AEGIS-O and selects the interface to be tested the Badge Setting screen is displayed. On the Badge Setting window, users can select test cases and configure profile information such as DUT information and network profile, etc. The Badge Status window shows the status of all scheduled test cases. Upon completion of each test case run, the test result is immediately displayed. Users have the option to save or submit results by exporting both the Badge Report and Detail Report. AEGIS-O’s Badge report form aligns with the O-RAN Alliance Badge program’s report structure, enabling vendors to prepare OTIC Tests, and allowing operators to easily compare it with other Badge reports. Users can also investigate packets and CDRs related to the particular test case if needed. In AEGIS-O, O-RAN WG5.IOT automated tests make it possible for operators to quickly and easily detect and analyze IOT problems with a real-time packet analysis feature. This approach offers a cost-effective way to verify the interoperability of operators\' O-RAN systems, which consist of products from multiple vendors. References [1] Overview of Open Testing and Integration Centre (OTIC) and O-RAN Certification and Badging Program: O-RAN ALLIANCE Test and Integration Focus Group, White Paper, April 2023
Oct 30, 2023
-
- Self-Attention-based Uplink Radio Resource Prediction in 5G Dual Connectivity
- Sungkyunkwan University conducted this study with the support of Accuver (XCAL-Solo III). They have proposed a self-attention-based deep learning model to predict uplink radio resource in 5G Dual Connectivity (5G DC). The model was trained on commercial 5G DC traffic data from three major carriers in South Korea and achieved an average prediction accuracy of 95.08% under various mobility and cell-load conditions.
Oct 27, 2023
-
- Tackling Beamforming Test Hurdles with XCAT-MAIS′s mMIMO Expertise
- By Dr. Joseph Lee [The definition and value of beamforming]Beamforming is a transmission technique that uses multiple array antennas to concentrate the power of a transmitted RF signal onto a particular user. A digital signal processing algorithm is used to apply relative amplitude and phase shifts to antenna elements in such a way that the signals join together towards a user’s location and cancel each other out in the opposite direction [1]. Figure 1. Massive MIMO antenna performing 3D (azimuth and elevation) beamforming. Beamforming plays a key role in performing multi-user multiple input, multiple output (MU-MIMO), in which concurrent users share time and frequency resources to dramatically increase the capacity of a channel. In a Massive MIMO antenna array, a large number of antenna elements (i.e., 64T/64R) serve users in different locations using beamforming. Using RF environments constructed for users that 2 employ signal concentration and canceling, multiple users achieve higher throughput at the same time and frequency. Together with higher carrier aggregation, higher-order modulation and enhanced use of unlicensed spectrum, beamforming/Massive MIMO can deliver Gigabit throughput in LTE-Advanced and 5G networks [2]. In urban, high data traffic environments where spectrum is limited, Massive MIMO’s beamforming technique is a significant advantage. By accommodating more concurrent users and giving them a better quality of service, beamforming allows mobile operators to attain a better return from their capital expenditure under limited resources. [How beamforming is performed between the base station and UE]There are two types of beam: a common beam used for the initial connection, and a dedicated beam used once that connection is established. Since a base station cannot locate a User Equipment (UE) at the time of its connection, the base station secures coverage through a time-sweep, with beams uniformly divided over space. Each beam contains a unique Synchronization Signal Block Beam ID (SSB ID) and Physical Beam Index (PBI). The UE informs the base station of its status, including SSB IDs and power information, in real time. Once the UE is connected to the base station, a dedicated beam for data transmission can be concentrated on the UE. The base station tracks the UE by measuring an uplink channel via a Sounding Reference Signal (SRS) transmitted from the UE. Then, the base station applies the uplink channel value to downlink channel value by using TDD channel reciprocity. Now, beamforming coefficients for each antenna can be calculated using channel value and a linear algebraic zero-forcing method, which helps minimize interference from other antennas. Multi-user MIMO is now performed through beamforming gain and interference rejection gain.[Beamforming KPIs] The list below highlights beamforming key performance indicators (KPIs) and illustrates why they are important to measure and analyze. The goalㅡTo verify whether throughput matches channel capacity, and if not, why. KPIs related to SSB/Common Beam ㆍNumber of detected SSBs A maximum of 64 SSBs can be transmitted. A base station can measure and estimate the location and direction of a UE using SSB IDsㅡor PBIsㅡthat it receives and reports. ㆍPBI and RSRP/RSRQ PBIs and associated power information received by a UE can be used to predict the handover situation of the UE. ㆍDMRS SINR Demodulation Reference Signal (DMRS) SINR can be used to estimate and receive channel characteristics. ㆍBeamforming gain This parameter can be used to estimate the efficiency of beamforming at the time of measurement. KPIs related to User/Dedicated-beam ㆍDMRS SINR Since multiple orthogonal DMRS signals can be allocated and beamformed to support MIMO transmission, DMRS SINR be used to estimate the degree of interference in each user signal in the corresponding physical channel. ㆍBeamforming Gain and Interference Rejection Gain Analyzing these KPIs can help estimate the performance of both channel estimation and interference rejection. [The challenges of measuring antenna beamforming performance]One way to measure a Massive MIMO’s beamforming performance is through field testing. Testing must be conducted among a representative number of UEs located in the sector (e.g. 16 UEs) and the UEs must be in different positions, i.e., not bunched together in a single location or line-of-sight spot. The UEs also need to support Transmission Mode 8 or 9 (TM8 or TM9) to report beam-specific KPIs. The idea is to measure how much gain a Massive MIMO antenna provides compared with a conventional antenna system. Through beamforming, a Massive MIMO antenna should provide better signal quality to each user. Hence, user throughput and sector throughput should be higher. For efficient field testing, Accuver XCAL-Manager and XCAL-Solo tools can be used. XCAL-Manager is a cloud-based server that allows users to assign test cases remotely to test UEs and monitor their status and locations in real time. It also allows users to choose which UEs to aggregate, so that they can see sector throughput in addition to user throughput. Indeed, Signals Research performed a similar Massive MIMO test recently using Accuver XCAL-Manager and XCAL-Solo tools [3]. If one conducts Massive MIMO/beamforming tests repeatedly, field tests are time- and resourceconsuming. Moreover, field tests don’t offer a repetitive and consistent test environment to verify Massive MIMO’s beamforming performance, or identify problems caused by multiple sources. One way to perform the test in a simpler way is to bring the field RF environment into a lab and test it repeatedly using a channel emulator. A channel emulator is an instrument that takes RF inputs to generate RF outputs and combines internally-generated multi-path signals with individual amplitude and phase gain control, including propagation delay and path loss implementation. To measure beamforming performance accurately, a channel emulator should secure ‘channel reciprocity,’ in which a downlink channel is equal to an uplink channelㅡsimilar to a real, over-the-air channel. However, a channel emulator is an electronic instrument incorporating RF and digital circuits which would not usually satisfy the channel reciprocity requirement. Hence, to meet that requirement, the channel emulator must be equipped with an internal or external calibration function. Since by nature RF components’ characteristics drift with temperature, calibration should be performed on a regular basis. Therefore, it is critical that the calibration function does its job in a relatively short period of timeㅡlest too much time is wasted on calibrations. [Introducing Accuver XCAT-MAIS]The Accuver Massive MIMO Channel Emulator (MAIS) is the latest addition to the Radio Access Network (RAN) Testing portfolioㅡpart of Accuver’s Field-to-Lab (F2L) testing solutions. F2L products deliver quick, cost-effective RAN software verification in real-world-like lab environments prior to field deployment. XCAT-MAIS is a channel emulator with M inputs to connect to BS antenna ports, and N outputs to connect to UE antenna ports. MAIS supports various M x N configurations, allowing users to test the performance ofㅡfor exampleㅡa 16 x 16 LTE FD-MIMO or a 64 x 64 5G Massive MIMO system. For RAN vendors, MAIS provides a repetitive, consistent test environment to verify Massive MIMO performance. For wireless operators, MAIS enables the comparison of FD/Massive MIMO performance from different RAN vendors in the same RF environment. Both these use cases are difficult to achieve with field testing due to variables present in the field environment. Figure 2. Accuver MAIS systemThe MAIS system supports a 100 MHz channel bandwidth for 5G testing, and frequencies of between 300 MHz to 6 GHz. It features a built-in calibration kit that is fast and accurate; and typically achieves the following specification within 15 minutes: |amplitude| < 0.35dB and |phase| < 3 degree; and it sustains the calibrated state for up to 72 hours. [XCAT-MAIS benefits]MAIS offers users the following benefits: Adjustable amplitude and phase rotation Monitoring of BS and UE outputs Support of ITU channel models and user-defined models Support for distributed, remote testing configuration Measurement of beam tracking performance. MAIS has signal capturing function at both the BS and UE sides to measure all beamforming KPIs listed above. Fast self-calibration ? typically within 15 minutes. Calibration hardware is included in MAIS to ensure it creates channel conditions properly and achieves channel reciprocity within the specified [XCAT-MAIS specifications] Channel bandwidth of up to 100 MHz Frequency: 300 MHz to 6 GHz RF port capacity: a single MAIS chassis can support up to 64 RF ports (16 slots, 4 RF ports per slot) Channel reciprocity (for TDD) with calibration tolerances of: o Amplitude = ±0.35 dB and phase ±3 degrees from any BS port to any UE port Support for DL 256QAM and UL 256 QAM, at a frequency of < 4 GHz Channel fading models: ITU Ped. A/B, Veh. A/B, EPA, EVA, ETU, 2D/3D SCM, HST, and user-defined Number of multipaths: 8 (expandable to 20) Doppler frequency of up to 1350 Hz (560km/h @ 2.6 GHz) AWGN built-in at each RF port[Signal and beamforming analysis with XCAT-MAIS]MAIS supports the following analysis: 1. Signal analysis on: a. Each RF port b. gNB and UE c. Relative power, OFDM, OBW and I/Q samples 2. Beamforming analysis on: a. RF ports b. SSB/common beam i. PCI, PBI, power, correlation accuracy, EVM, SINR ii. Relative phase-consistency c. PDSCH/dedicated-beam i. Relative phase-consistency ii. Beam-forming accuracy [Conclusion]Wireless technology is changing fast every day, and the complexity of testing and validating its features also grows exponentially. Such is the case with validating the performance of beamforming and Massive MIMO, two important features of 5G. Massive MIMO’s beamforming performance can be measured using field testing but doing so is very time- and resource-consuming. Moreover, the field doesn’t offer a repetitive and consistent test environment to troubleshoot problems that may be caused by multiple sources. Accuver MAIS (Massive MIMO Channel Emulator) provides a repetitive and consistent real-world-like test environment to verify and compare Massive MIMO product performance. MAIS system supports 100 MHz channel bandwidth for 5G testing and frequencies from 300 MHz to 6 GHz. It has a built-in calibration kit that is fast (within 15 minutes) and highly accurate ㅡ ensuring that little time is wasted in calibration ? so that users can get on with Massive MIMO testing quickly. References Masterson, C. (2017, June). Massive MIMO and beamforming: The signal processing behind the 5G buzzwords. Analog Dialogue, 51. Qualcomm. (2017, February). The essential role of Gigabit LTE & LTE Advanced Pro in a 5G World. Thelander, M. (2018, November). The matrix: Quantifying the benefits of 64T64R Massive MIMO with beamforming and multi-user MIMO capabilities. Signals Ahead, 14, no. 9
Oct 25, 2023
-
- [Signals Flash] WE′VE GOT YOU COVERED (TO VARYING DEGREES)
- SRG(Signal Research Group) did this study with the support of Accuver Americas (XCAL5 and XCAP). SRG used a Galaxy S23 smartphone to test the downlink performance in a cluster of 10 Gbps cell sites that had 1x180 MHz of Band n41, 2x20 MHz of Band n25, and 2x20 MHz of Band n71. We primarily did drive tests along the rural roads as well as in the suburban neighborhoods, which were ideal for a fixed wireless access (FWA) service offering.For more detailed information, please refer to attachment.
Oct 19, 2023
-
- Accuver Benchmarking Test Solutions
- As the advancement of 5G technology leads to increased mobile data usage, the necessity for benchmarking tests is growing in order to assess and compare network performance effectively. With over 20 years of experience in network optimization, Accuver offers a comprehensive solution to evaluate and compare mobile network performance, coverage, and service quality from the user\'s perspective. ▶ Click to get full version of Accuver Benchmarking Test Solutions
Aug 29, 2023
-
- [Signals Flash] IT′S GETTING HOT N HERE, SO...
- SRG(Signal Research Group) did this study with the support of Accuver Americas (XCAL5/XCAL-Solo and XCAP). SRG just completed its 32nd 5G benchmark study. For this endeavor SRG collaborated with Accuver Americas to conduct an independentbenchmark study of 5G mmWave 4 component carrier (4CC) uplink performance, using AT&T’s commercial network in Glendale, AZ.For more detailed information, please refer to attachment.
Jul 10, 2023
-
- Accuver Airspace Network Test Solution (Korean case study)
- Airspace Network in 5G The development of a unified network infrastructure integrating Non-Terrestrial Network (NTN) platforms within the scope of 5G and future 6G technology is currently in progress. Standardization organizations like 3GPP are actively working on defining communication standards specifically tailored for Unmanned Aerial Vehicles (UAVs). Efficient performance testing and optimization of airspace networks are crucial to ensure seamless integration of communication services with UAV operations.The implementation of an airspace network in 5G technology presents unique considerations and challenges compared to traditional terrestrial networks Weak signal power from base stations to UAVs:Terrestrial networks are primarily optimized for User Equipment (UE) operating at heights ranging from 1 to 2 meters above ground level (AGL). Radio waves propagating skywards experience a decrease in signal strength compared to the ground. Establishing communication with UAVs may require the use of supplementary base stations or antenna uptilting techniques.Impact of UAV communication on ground users:Radio waves emitted by UAVs can extend to distant areas and potentially interfere with nearby base stations, smartphones, and other devices. Ensuring minimal interference and maintaining the quality of service for ground users is a critical challenge.New use cases :With the ongoing deployment of NR (New Radio) mobile networks, novel use cases will emerge as UAVs enter the market and leverage the ultra-high speed, large-capacity, ultra-reliable, low-latency communications, and multiple simultaneous connection features offered by NR.Overcoming these challenges requires optimizing signal strength for UAVs, mitigating interference with ground users, and exploring new use cases enabled by the capabilities of NR. Efforts by standardization organizations and the industry as a whole aim to address these challenges and pave the way for seamless integration of airspace networks within the 5G ecosystem.South Korea Usecase UAM Grand Challenge Korea The deployment and optimization of 5G airspace networks in Korea are driven by the objective of facilitating the commercialization of Urban Air Mobility services by 2025. To ensure a reliable and robust network infrastructure at altitudes ranging from 300 meters to 600 meters above the ground, Korean operators are employing dedicated gNBs and implementing antenna tilting and beam pattern optimization techniques. These strategies aim to provide seamless connectivity, enhanced signal strength, and reduced latency for UAM operations, thus supporting the realization of a safe and efficient urban air transportation ecosystem.Accuver Airspace Network Test Solution XCAL-Air XCAL-Air is an advanced and comprehensive package specifically developed for measuring and analyzing the performance of airspace networks. It is designed to effectively identify and rectify coverage gaps to ensure optimal network performance in airspace environments. This technologically advanced solution incorporates various network equipment, including spectrum analyzers, scanners, and mobile network measurement devices. It offers a comprehensive set of features to enable efficient network verification in airspace environments.[ Key Features of XCAL-Air ]Airspace Network Performance Measurement:XCAL-Air provides a range of powerful measurement capabilities to assess the performance of airspace networks.It captures and analyzes various network parameters such as signal strength, signal quality, throughput, latency, and other key performance indicators (KPIs) in real-time.These measurements help in evaluating the network\'s coverage, capacity, and overall performance, enabling operators to identify areas of improvement.Integration with XCAL-Manager Air:The measured data collected by XCAL-Air is seamlessly transferred to XCAL-Manager Air for further analysis and evaluation.XCAL-Manager Air is a centralized management platform equipped with advanced analytics tools, allowing for in-depth assessment of airspace network performance.Accurate Global Navigation Satellite System (GNSS) information is associated with the measured data, facilitating precise location-based analysis of airspace network performance.[ Benefits of XCAL-Air ]Comprehensive Performance Analysis: XCAL-Air provides a comprehensive set of measurements, enabling operators to gain valuable insights into the performance of airspace networks.Coverage Gap Identification: By analyzing the collected data, XCAL-Air identifies coverage gaps and areas with suboptimal network performance, allowing operators to take corrective actions.Real-Time Monitoring on 3D Map: The solution offers real-time monitoring capabilities, providing operators with immediate visibility into network performance and enabling proactive troubleshooting.Data-Driven Decision Making: XCAL-Air\'s integration with XCAL-Manager Air enables operators to perform advanced analytics and make data-driven decisions for optimizing airspace network performance.XCAL-Manager Air The XCAL-Air Ground Management System comprises two key components: XCAL-Manager Air and DROW4D. These components work in tandem to control and schedule remote tests for XCAL-Air, a specialized network testing tool designed for airspace networks. The XCAL-Air ground management system ensures efficient management, analysis, and verification of network performance.XCAL-Manager Air serves as the central control system for managing and scheduling remote tests conducted by XCAL-Air drones. It facilitates the planning and scheduling of network performance measurements in the air, based on predefined test scenarios. XCAL-Manager Air collects and analyzes the test results generated by XCAL-Air, providing valuable insights into network performance. DROW4D is an integral part of the XCAL-Air ground management system, specifically designed to control and manage XCAL-Air drones. It enables the autonomous operation of multiple drones, ensuring coordinated and synchronized flights for efficient network testing.DROW4D assigns missions to the drones based on the test scenarios set in XCAL-Manager Air, pre-configures flight routes, and controls the drones during the testing process.Key Features of the XCAL-Air Ground Management System:Real-time Network Performance Monitoring on 3D Map:The measured key performance indicators (KPIs) obtained from the network tests are displayed on a 3D map, providing a visual representation of network performance.This visualization aids in identifying coverage gaps and areas requiring optimization or further investigation.Autonomous Drone Control:DROW4D enables autonomous operation of XCAL-Air drones, leveraging real-time wireless network environment data for precise aircraft control.Advanced drone control capabilities, including fail-safe return, extended measurement functionality, and mission reconfiguration in response to specific wireless network events, are facilitated by the DROW4D system. The XCAL-Air and XCAL-Manager Air packages represent a robust and all-encompassing solution for measuring and analyzing the performance of airspace networks. With their powerful capabilities, operators gain the ability to identify coverage gaps, obtain precise measurements, and efficiently manage remote tests while analyzing test results. Moreover, the visual representation of network performance on a 3D map adds an extra layer of insight and understanding. By leveraging these comprehensive packages, operators can optimize network performance, enhance coverage, and deliver a seamless and dependable communication experience in airspace environments.
Jun 15, 2023