title: Multi-Modal Motion Planning Using Composite Pose Graph Optimization

abstract: In this paper, we present a motion planning framework for multi-modal vehicle dynamics. Our proposed algorithm employs transcription of the optimization objective function, vehicle dynamics, and state and control constraints into sparse factor graphs, which -- combined with mode transition constraints -- constitute a composite pose graph. By formulating the multi-modal motion planning problem in composite pose graph form, we enable utilization of efficient techniques for optimization on sparse graphs, such as those widely applied in dual estimation problems, e.g., simultaneous localization and mapping (SLAM). The resulting motion planning algorithm optimizes the multi-modal trajectory, including the location of mode transitions, and is guided by the pose graph optimization process to eliminate unnecessary transitions, enabling efficient discovery of optimized mode sequences from rough initial guesses. We demonstrate multi-modal trajectory optimization in both simulation and real-world experiments for vehicles with various dynamics models, such as an airplane with taxi and flight modes, and a vertical take-off and landing (VTOL) fixed-wing aircraft that transitions between hover and horizontal flight modes.


title: Estimates for the Branching Factors of Atari Games

abstract: The branching factor of a game is the average number of new states reachable from a given state. It is a widely used metric in AI research on board games, but less often computed or discussed for videogames. This paper provides estimates for the branching factors of 103 Atari 2600 games, as implemented in the Arcade Learning Environment (ALE). Depending on the game, ALE exposes between 3 and 18 available actions per frame of gameplay, which is an upper bound on branching factor. This paper shows, based on an enumeration of the first 1 million distinct states reachable in each game, that the average branching factor is usually much lower, in many games barely above 1. In addition to reporting the branching factors, this paper aims to clarify what constitutes a distinct state in ALE.


title: Disformal map and Petrov classification in modified gravity

abstract: Disformal transformation provides a map relating different scalar-tensor and vector-tensor theories and gives access to a powerful solution-generating method in modified gravity. In view of the vast family of new solutions one can achieve, it is crucial to design suitable tools to guide their construction. In this work, we address this question by revisiting the Petrov classification of disformally constructed solutions in modified gravity theories. We provide close formulas which relate the principal nulls directions as well as the Weyl scalars before and after the disformal transformation. These formulas allow one to capture if and how the Petrov type of a given seed geometry changes under a disformal transformation. Finally, we apply our general setup to three relevant disformally constructed solutions for which the seeds are respectively homogeneous and isotropic, static spherically symmetric and stationary axisymmetric. For the first two cases, we show that the Petrov type O and Petrov type D remain unchanged after a disformal transformation while we show that disformed Kerr black hole is no longer of type D but of general Petrov type I. The results presented in this work should serve as a new toolkit when constructing and comparing new disformal solutions in modified gravity.


title: Developing compact tuning fork thermometers for sub-mK temperatures and high magnetic fields

abstract: There is a growing demand for experiments on calorimetric and thermal transport measurements at ultra-low temperatures below 1 mK and high magnetic fields up to 16 T. Particularly, milligram-sized solid samples are of great interest. We present the development of scalable thermometers based on quartz tuning fork resonators immersed in liquid 3He and adapt hydrodynamic models to provide an improved description of temperature dependence in the high viscosity regime between 1 and 10 mK. We demonstrate successful thermometer operation and discuss the feasibility of fast and compact thermal probes suitable for small samples.


title: CAP-RAM: A Charge-Domain In-Memory Computing 6T-SRAM for Accurate and Precision-Programmable CNN Inference

abstract: A compact, accurate, and bitwidth-programmable in-memory computing (IMC) static random-access memory (SRAM) macro, named CAP-RAM, is presented for energy-efficient convolutional neural network (CNN) inference. It leverages a novel charge-domain multiply-and-accumulate (MAC) mechanism and circuitry to achieve superior linearity under process variations compared to conventional IMC designs. The adopted semi-parallel architecture efficiently stores filters from multiple CNN layers by sharing eight standard 6T SRAM cells with one charge-domain MAC circuit. Moreover, up to six levels of bit-width of weights with two encoding schemes and eight levels of input activations are supported. A 7-bit charge-injection SAR (ciSAR) analog-to-digital converter (ADC) getting rid of sample and hold (S&H) and input/reference buffers further improves the overall energy efficiency and throughput. A 65-nm prototype validates the excellent linearity and computing accuracy of CAP-RAM. A single 512x128 macro stores a complete pruned and quantized CNN model to achieve 98.8% inference accuracy on the MNIST data set and 89.0% on the CIFAR-10 data set, with a 573.4-giga operations per second (GOPS) peak throughput and a 49.4-tera operations per second (TOPS)/W energy efficiency.


title: Learning Semantic Segmentation of Large-Scale Point Clouds with Random Sampling

abstract: We study the problem of efficient semantic segmentation of large-scale 3D point clouds. By relying on expensive sampling techniques or computationally heavy pre/post-processing steps, most existing approaches are only able to be trained and operate over small-scale point clouds. In this paper, we introduce RandLA-Net, an efficient and lightweight neural architecture to directly infer per-point semantics for large-scale point clouds. The key to our approach is to use random point sampling instead of more complex point selection approaches. Although remarkably computation and memory efficient, random sampling can discard key features by chance. To overcome this, we introduce a novel local feature aggregation module to progressively increase the receptive field for each 3D point, thereby effectively preserving geometric details. Comparative experiments show that our RandLA-Net can process 1 million points in a single pass up to 200x faster than existing approaches. Moreover, extensive experiments on five large-scale point cloud datasets, including Semantic3D, SemanticKITTI, Toronto3D, NPM3D and S3DIS, demonstrate the state-of-the-art semantic segmentation performance of our RandLA-Net.


title: CausalRec: Causal Inference for Visual Debiasing in Visually-Aware Recommendation

abstract: Visually-aware recommendation on E-commerce platforms aims to leverage visual information of items to predict a user's preference. It is commonly observed that user's attention to visual features does not always reflect the real preference. Although a user may click and view an item in light of a visual satisfaction of their expectations, a real purchase does not always occur due to the unsatisfaction of other essential features (e.g., brand, material, price). We refer to the reason for such a visually related interaction deviating from the real preference as a visual bias. Existing visually-aware models make use of the visual features as a separate collaborative signal similarly to other features to directly predict the user's preference without considering a potential bias, which gives rise to a visually biased recommendation. In this paper, we derive a causal graph to identify and analyze the visual bias of these existing methods. In this causal graph, the visual feature of an item acts as a mediator, which could introduce a spurious relationship between the user and the item. To eliminate this spurious relationship that misleads the prediction of the user's real preference, an intervention and a counterfactual inference are developed over the mediator. Particularly, the Total Indirect Effect is applied for a debiased prediction during the testing phase of the model. This causal inference framework is model agnostic such that it can be integrated into the existing methods. Furthermore, we propose a debiased visually-aware recommender system, denoted as CausalRec to effectively retain the supportive significance of the visual information and remove the visual bias. Extensive experiments are conducted on eight benchmark datasets, which shows the state-of-the-art performance of CausalRec and the efficacy of debiasing.


title: The GRAVITY Young Stellar Object Survey. VI. Mapping the variable inner disk of HD 163296 at sub-au scales

abstract: Protoplanetary disks drive some of the formation process (e.g., accretion, gas dissipation, formation of structures, etc.) of stars and planets. Understanding such physical processes is one of the main astrophysical questions. HD 163296 is an interesting young stellar object for which infrared and sub-millimeter observations have shown a prominent circumstellar disk with gaps plausibly created by forming planets. This study aims at characterizing the morphology of the inner disk in HD 163296 with multi-epoch near-infrared interferometric observations performed with GRAVITY at the Very Large Telescope Interferometer (VLTI). Our goal is to depict the K-band (lambda_0 ~ 2.2 um) structure of the inner rim with milliarcsecond (sub-au) angular resolution. Our data is complemented with archival PIONIER (H-band; lambda_0 ~ 1.65 um) data of the source. We performed a Gradient Descent parametric model fitting to recover the sub-au morphology of our source. Our analysis shows the existence of an asymmetry in the disk surrounding the central star of HD 163296. We confirm variability of the disk structure in the inner ~2 mas (0.2 au). While variability of the inner disk structure in this source has been suggested by previous interferometric studies, this is the first time that it is confirmed in the H- and K-bands by using a complete analysis of the closure phases and squared visibilities over several epochs. Because of the separation from the star, position changes, and persistence of this asymmetric structure on timescales of several years, we argue that it is a dusty feature (e.g., a vortex or dust clouds), probably, made by a mixing of sillicate and carbon dust and/or refractory grains, inhomogeneously distributed above the mid-plane of the disk.


title: Dirichlet Energy Constrained Learning for Deep Graph Neural Networks

abstract: Graph neural networks (GNNs) integrate deep architectures and topological structure modeling in an effective way. However, the performance of existing GNNs would decrease significantly when they stack many layers, because of the over-smoothing issue. Node embeddings tend to converge to similar vectors when GNNs keep recursively aggregating the representations of neighbors. To enable deep GNNs, several methods have been explored recently. But they are developed from either techniques in convolutional neural networks or heuristic strategies. There is no generalizable and theoretical principle to guide the design of deep GNNs. To this end, we analyze the bottleneck of deep GNNs by leveraging the Dirichlet energy of node embeddings, and propose a generalizable principle to guide the training of deep GNNs. Based on it, a novel deep GNN framework -- EGNN is designed. It could provide lower and upper constraints in terms of Dirichlet energy at each layer to avoid over-smoothing. Experimental results demonstrate that EGNN achieves state-of-the-art performance by using deep layers.


title: MSE Loss with Outlying Label for Imbalanced Classification

abstract: In this paper, we propose mean squared error (MSE) loss with outlying label for class imbalanced classification. Cross entropy (CE) loss, which is widely used for image recognition, is learned so that the probability value of true class is closer to one by back propagation. However, for imbalanced datasets, the learning is insufficient for the classes with a small number of samples. Therefore, we propose a novel classification method using the MSE loss that can be learned the relationships of all classes no matter which image is input. Unlike CE loss, MSE loss is possible to equalize the number of back propagation for all classes and to learn the feature space considering the relationships between classes as metric learning. Furthermore, instead of the usual one-hot teacher label, we use a novel teacher label that takes the number of class samples into account. This induces the outlying label which depends on the number of samples in each class, and the class with a small number of samples has outlying margin in a feature space. It is possible to create the feature space for separating high-difficulty classes and low-difficulty classes. By the experiments on imbalanced classification and semantic segmentation, we confirmed that the proposed method was much improved in comparison with standard CE loss and conventional methods, even though only the loss and teacher labels were changed.


title: Face masks, vaccination rates and low crowding drive the demand for the London Underground during the COVID-19 pandemic

abstract: The COVID-19 pandemic has drastically impacted people's travel behaviour and out-of-home activity participation. While countermeasures are being eased with increasing vaccination rates, the demand for public transport remains uncertain. To investigate user preferences to travel by London Underground during the pandemic, we conducted a stated choice experiment among its pre-pandemic users (N=961). We analysed the collected data using multinomial and mixed logit models. Our analysis provides insights into the sensitivity of the demand for the London Underground with respect to travel attributes (crowding density and travel time), the epidemic situation (confirmed new COVID-19 cases), and interventions (vaccination rates and mandatory face masks). Mandatory face masks and higher vaccination rates are the top two drivers of travel demand for the London Underground during COVID-19. The positive impact of vaccination rates on the Underground demand increases with crowding density, and the positive effect of mandatory face masks decreases with travel time. Mixed logit reveals substantial preference heterogeneity. For instance, while the average effect of mandatory face masks is positive, preferences of around 20% of the pre-pandemic users to travel by the Underground are negatively affected. The estimated demand sensitivities are relevant for supply-demand management in transit systems and the calibration of advanced epidemiological models.


title: COSPEX: A Program Comprehension Tool for Novice Programmers

abstract: Developers often encounter unfamiliar code during software maintenance which consumes a significant amount of time for comprehension, especially for novice programmers. Automated techniques that analyze a source code and present key information to the developers can lead to an effective comprehension of the code. Researchers have come up with automated code summarization techniques that focus on code summarization by generating brief summaries rather than aiding its comprehension. Existing debuggers represent the execution states of the program but they do not show the complete execution at a single point. Studies have revealed that the effort required for program comprehension can be reduced if novice programmers are provided with worked examples. Hence, we propose COSPEX (Comprehension using Summarization via Program Execution) - an Atom plugin that dynamically extracts key information for every line of code executed and presents it to the developers in the form of an interactive example-like dynamic information instance. As a preliminary evaluation, we presented 14 undergraduates having Python programming experience up to 1 year with a code comprehension task in a user survey. We observed that COSPEX helped novice programmers in program comprehension and improved their understanding of the code execution. The source code and tool are available at: https://bit.ly/3utHOBM, and the demo on Youtube is available at: https://bit.ly/2Sp08xQ.


title: Semi-TCL: Semi-Supervised Track Contrastive Representation Learning

abstract: Online tracking of multiple objects in videos requires strong capacity of modeling and matching object appearances. Previous methods for learning appearance embedding mostly rely on instance-level matching without considering the temporal continuity provided by videos. We design a new instance-to-track matching objective to learn appearance embedding that compares a candidate detection to the embedding of the tracks persisted in the tracker. It enables us to learn not only from videos labeled with complete tracks, but also unlabeled or partially labeled videos. We implement this learning objective in a unified form following the spirit of constrastive loss. Experiments on multiple object tracking datasets demonstrate that our method can effectively learning discriminative appearance embeddings in a semi-supervised fashion and outperform state of the art methods on representative benchmarks.


title: Deep Network Approximation: Achieving Arbitrary Accuracy with Fixed Number of Neurons

abstract: This paper develops simple feed-forward neural networks that achieve the universal approximation property for all continuous functions with a fixed finite number of neurons. These neural networks are simple because they are designed with a simple, computable, and continuous activation function $\sigma$ leveraging a triangular-wave function and the softsign function. We first prove that $\sigma$-activated networks with width $36d(2d+1)$ and depth $11$ can approximate any continuous function on a $d$-dimensional hypercube within an arbitrarily small error. Hence, for supervised learning and its related regression problems, the hypothesis space generated by these networks with a size not smaller than $36d(2d+1)\times 11$ is dense in the continuous function space $C([a,b]^d)$ and therefore dense in the Lebesgue spaces $L^p([a,b]^d)$ for $p\in [1,\infty)$. Furthermore, we show that classification functions arising from image and signal classification are in the hypothesis space generated by $\sigma$-activated networks with width $36d(2d+1)$ and depth $12$ when there exist pairwise disjoint bounded closed subsets of $\mathbb{R}^d$ such that the samples of the same class are located in the same subset. Finally, we use numerical experimentation to show that replacing the rectified linear unit (ReLU) activation function by ours would improve the experiment results.


title: From General to Specific: Online Updating for Blind Super-Resolution

abstract: Most deep learning-based super-resolution (SR) methods are not image-specific: 1) They are trained on samples synthesized by predefined degradations (e.g. bicubic downsampling), regardless of the domain gap between training and testing data. 2) During testing, they super-resolve all images by the same set of model weights, ignoring the degradation variety. As a result, most previous methods may suffer a performance drop when the degradations of test images are unknown and various (i.e. the case of blind SR). To address these issues, we propose an online SR (ONSR) method. It does not rely on predefined degradations and allows the model weights to be updated according to the degradation of the test image. Specifically, ONSR consists of two branches, namely internal branch (IB) and external branch (EB). IB could learn the specific degradation of the given test LR image, and EB could learn to super resolve images degraded by the learned degradation. In this way, ONSR could customize a specific model for each test image, and thus get more robust to various degradations. Extensive experiments on both synthesized and real-world images show that ONSR can generate more visually favorable SR results and achieve state-of-the-art performance in blind SR.


title: SOCluster- Towards Intent-based Clustering of Stack Overflow Questions using Graph-Based Approach

abstract: Stack Overflow (SO) platform has a huge dataset of questions and answers driven by interactions between users. But the count of unanswered questions is continuously rising. This issue is common across various community Question & Answering platforms (Q&A) such as Yahoo, Quora and so on. Clustering is one of the approaches used by these communities to address this challenge. Specifically, Intent-based clustering could be leveraged to answer unanswered questions using other answered questions in the same cluster and can also improve the response time for new questions. It is here, we propose SOCluster, an approach and a tool to cluster SO questions based on intent using a graph-based clustering approach. We selected four datasets of 10k, 20k, 30k & 40k SO questions without code-snippets or images involved, and performed intent-based clustering on them. We have done a preliminary evaluation of our tool by analyzing the resultant clusters using the commonly used metrics of Silhouette coefficient, Calinkski-Harabasz Index, & Davies-Bouldin Index. We performed clustering for 8 different threshold similarity values and analyzed the intriguing trends reflected by the output clusters through the three evaluation metrics. At 90% threshold similarity, it shows the best value for the three evaluation metrics on all four datasets. The source code and tool are available for download on Github at: https://github.com/Liveitabhi/SOCluster, and the demo can be found here: https://youtu.be/uyn8ie4h3NY.


title: On the Thermofluidics of a Steady Laminar Jet Impacting on a Rotating Hot Plate: An ab-initio Scaling Perspective

abstract: We provide an ab-initio scaling analysis for liquid film thickness and Nusselt number of a steady laminar jet impacting a rotating heated plate. The limiting scaling regimes incorporating the evaporative effects along the liquid-vapor interface have been probed. The dependence of liquid film thickness and Nusselt number on Reynolds, Rossby, and Prandtl number have been unearthed using scaling analysis of the integral and differential form of the continuity, Navier-Stokes and energy equation in a cylindrical coordinate system. Boundary layer analysis has been used to discover a critical length that plays a significant role in understanding the effect of evaporation on hydrodynamic, thermal boundary layer thicknesses, and subsequently Nusselt number. The evaporative effects on liquid film thickness become increasingly important after a certain critical radius. The scaling laws derived were compared with existing experimental data available in the literature, and the trends predicted were consistent.


title: Machine learning assisted quantum super-resolution microscopy

abstract: One of the main characteristics of optical imaging systems is the spatial resolution, which is restricted by the diffraction limit to approximately half the wavelength of the incident light. Along with the recently developed classical super-resolution techniques, which aim at breaking the diffraction limit in classical systems, there is a class of quantum super-resolution techniques which leverage the non-classical nature of the optical signals radiated by quantum emitters, the so-called antibunching super-resolution microscopy. This approach can ensure a factor of $\sqrt{n}$ improvement in the spatial resolution by measuring the n-th order autocorrelation function. The main bottleneck of the antibunching super-resolution microscopy is the time-consuming acquisition of multi-photon event histograms. We present a machine learning-assisted approach for the realization of rapid antibunching super-resolution imaging and demonstrate 12 times speed-up compared to conventional, fitting-based autocorrelation measurements. The developed framework paves the way to the practical realization of scalable quantum super-resolution imaging devices that can be compatible with various types of quantum emitters.


title: Valence quark distributions of light mesons in light-cone quark model

abstract: In order to investigate the tomographical structure of light pseudoscalar mesons, particularly, pion and kaon, we study the valence quark distribution function (PDF) and the generalized parton distributions (GPDs) using light-cone quark model (LCQM).


title: Fluctuation bounds for ergodic averages of amenable groups

abstract: We study fluctuations of ergodic averages generated by actions of amenable groups. In the setting of an abstract ergodic theorem for locally compact second countable amenable groups acting on uniformly convex Banach spaces, we deduce a highly uniform bound on the number of fluctuations of the ergodic average for a class of F{\o}lner sequences satisfying an analogue of Lindenstrauss's temperedness condition. Equivalently, we deduce a uniform bound on the number of fluctuations over long distances for arbitrary F{\o}lner sequences. As a corollary, these results imply associated bounds for a continuous action of an amenable group on a $\sigma$-finite $L^{p}$ space with $p\in(1,\infty)$.


title: Mach Number Dependence of Ion-scale Kinetic Instability at Collisionless Perpendicular Shock: Condition for Weibel-dominated Shock

abstract: We investigate ion-scale kinetic plasma instabilities at the collisionless shock using linear theory and nonlinear Particle-in-Cell (PIC) simulations. We focus on the Alfv\'en-ion-cyclotron (AIC), mirror, and Weibel instabilities, which are all driven unstable by the effective temperature anisotropy induced by the shock-reflected ions within the transition layer of a strictly perpendicular shock. We conduct linear dispersion analysis with a homogeneous plasma model to mimic the shock transition layer by adopting a ring distribution with finite thermal spread to represent the velocity distribution of the reflected ions. We find that, for wave propagation parallel to the ambient magnetic field, the AIC instability at lower Alfv\'en Mach numbers tends to transition to the Weibel instability at higher Alfv\'en Mach numbers. The instability property is, however, also strongly affected by the sound Mach number. We conclude that the instability at a strong shock with Alfv\'en and sound Mach numbers both in excess of $\sim 20{\rm -}40$ may be considered as Weibel-like in the sense that the reflected ions behave essentially unmagnetized. Two-dimensional PIC simulations confirm the linear theory and find that, with typical parameters of young supernova remnant shocks, the ring distribution model produces magnetic fluctuations of the order of the background magnetic field, which is smaller than those observed in previous PIC simulations for Weibel-dominated shocks. This indicates that the assumption of the gyrotropic reflected ion distribution may not be adequate to quantitatively predict nonlinear behaviors of the dynamics in high Mach number shocks.


title: Decoherence of Atomic Ensembles in Optical Lattice Clocks by Gravity

abstract: Optical lattice clocks can now resolve the height difference below 1 mm within an atomic ensemble by means of gravitational redshift with integration over sufficient amount of time. Further improvement in the stability enables the clocks to resolve the height difference of subsystems within an atomic ensemble that is conventionally interrogated as a single coherent spin state in a single Ramsey sequence, resulting in the dephasing of the coherent spin state. This effect is observable with a clock of a stability of $\lesssim 10^{-21}$ by introducing a single-layer-resolved imaging system for a three-dimensional optical lattice, and limits the 1 s stability of the clock around $10^{-19}$ for an atomic ensemble distributing symmetrically for the three axes, which is also a signal of the decoherence. With atoms in an entangled state, this can be the first observation of the decoherence of a quantum state by a gravitational effect, and the suppression of other systematic shifts to observe this decoherence seems feasible.


title: Special Purpose Computers for Statistical Physics: achievements and lessons

abstract: In the late 80s and 90s, theoretical physicists of the Landau Institute for Theoretical Physics designed and developed several specialized computers for challenging computational problems in the physics of phase transitions. These computers did not have a central processing unit. They optimize algorithms to handle elementary operations on integers -- read, write, compare, and count. The approach allowed them to achieve recording run times. Computers performed calculations three orders of magnitude faster than similar calculations on the world's best supercomputers. The approach made it possible to obtain fundamentally new results, some of which have not yet been surpassed in the accuracy of calculations. The report will present the main ideas for the development of specialized computers and the scientific results obtained with their help. The lessons of planning and execution of long-term complex scientific projects will also be discussed.


title: NRST: Non-rigid Surface Tracking from Monocular Video

abstract: We propose an efficient method for non-rigid surface tracking from monocular RGB videos. Given a video and a template mesh, our algorithm sequentially registers the template non-rigidly to each frame. We formulate the per-frame registration as an optimization problem that includes a novel texture term specifically tailored towards tracking objects with uniform texture but fine-scale structure, such as the regular micro-structural patterns of fabric. Our texture term exploits the orientation information in the micro-structures of the objects, e.g., the yarn patterns of fabrics. This enables us to accurately track uniformly colored materials that have these high frequency micro-structures, for which traditional photometric terms are usually less effective. The results demonstrate the effectiveness of our method on both general textured non-rigid objects and monochromatic fabrics.


title: CoReD: Generalizing Fake Media Detection with Continual Representation using Distillation

abstract: Over the last few decades, artificial intelligence research has made tremendous strides, but it still heavily relies on fixed datasets in stationary environments. Continual learning is a growing field of research that examines how AI systems can learn sequentially from a continuous stream of linked data in the same way that biological systems do. Simultaneously, fake media such as deepfakes and synthetic face images have emerged as significant to current multimedia technologies. Recently, numerous method has been proposed which can detect deepfakes with high accuracy. However, they suffer significantly due to their reliance on fixed datasets in limited evaluation settings. Therefore, in this work, we apply continuous learning to neural networks' learning dynamics, emphasizing its potential to increase data efficiency significantly. We propose Continual Representation using Distillation (CoReD) method that employs the concept of Continual Learning (CL), Representation Learning (RL), and Knowledge Distillation (KD). We design CoReD to perform sequential domain adaptation tasks on new deepfake and GAN-generated synthetic face datasets, while effectively minimizing the catastrophic forgetting in a teacher-student model setting. Our extensive experimental results demonstrate that our method is efficient at domain adaptation to detect low-quality deepfakes videos and GAN-generated images from several datasets, outperforming the-state-of-art baseline methods.


title: Edge-powered Assisted Driving For Connected Cars

abstract: Assisted driving for connected cars is one of the main applications that 5G-and-beyond networks shall support. In this work, we propose an assisted driving system leveraging the synergy between connected vehicles and the edge of the network infrastructure, in order to envision global traffic policies that can effectively drive local decisions. Local decisions concern individual vehicles, e.g., which vehicle should perform a lane-change manoeuvre and when; global decisions, instead, involve whole traffic flows. Such decisions are made at different time scales by different entities, which are integrated within an edge-based architecture and can share information. In particular, we leverage a queuing-based model and formulate an optimization problem to make global decisions on traffic flows. To cope with the problem complexity, we then develop an iterative, linear-time complexity algorithm called Bottleneck Hunting (BH). We show the performance of our solution using a realistic simulation framework, integrating a Python engine with ns-3 and SUMO, and considering two relevant services, namely, lane change assistance and navigation, in a real-world scenario. Results demonstrate that our solution leads to a reduction of the vehicles' travel times by 66 in the case of lane change assistance and by 20 for navigation, compared to traditional, local-coordination approaches.


title: Non-local sidewall response and deviation from exact quantization of the topological magnetoelectric effect in axion-insulator thin films

abstract: Topological insulator (TI) thin films with surface magnetism are expected to exhibit a quantized anomalous Hall effect (QAHE) when the magnetizations on the top and bottom surfaces are parallel, and a quantized topological magnetoelectric (QTME) response when the magnetizations have opposing orientations (axion insulator phase) and the films are sufficiently thick. We present a unified picture of both effects that associates deviations from exact quantization of the QTME caused by finite thickness with non-locality in the side-wall current response function. Using realistic tight-binding model calculations, we show that in $Bi_2Se_3$ TI thin films deviations from quantization in the axion insulator-phase are reduced in size when the exchange coupling of tight-binding model basis states to the local magnetization near the surface is strengthened. Stronger exchange coupling also reduces the effect of potential disorder, which is unimportant for the QAHE but detrimental for the QTME, which requires that the Fermi energy lie inside the gap at all positions.


title: Adapting Vehicle Detector to Target Domain by Adversarial Prediction Alignment

abstract: While recent advancement of domain adaptation techniques is significant, most of methods only align a feature extractor and do not adapt a classifier to target domain, which would be a cause of performance degradation. We propose novel domain adaptation technique for object detection that aligns prediction output space. In addition to feature alignment, we aligned predictions of locations and class confidences of our vehicle detector for satellite images by adversarial training. The proposed method significantly improved AP score by over 5%, which shows effectivity of our method for object detection tasks in satellite images.


title: GBLinks: GNN-Based Beam Selection and Link Activation for Ultra-dense D2D mmWave Networks

abstract: In this paper, we consider the problem of joint beam selection and link activation across a set of communication pairs to effectively control the interference between communication pairs via inactivating part communication pairs in ultra-dense device-to-device (D2D) mmWave communication networks. The resulting optimization problem is formulated as an integer programming problem that is nonconvex and NP-hard. Consequently, the global optimal solution, even the local optimal solution, cannot be generally obtained. To overcome this challenge, this paper resorts to design a deep learning architecture based on graph neural network to finish the joint beam selection and link activation, with taking the network topology information into account. Meanwhile, we present an unsupervised Lagrangian dual learning framework to train the parameters of the GBLinks model. Numerical results show that the proposed GBLinks model can converges to a stable point with the number of iterations increases, in terms of the weighted sum rate. Furthermore, the GBLinks model can reach near-optimal solution through comparing with the exhaustive search scheme in small-scale ultra-dense D2D mmWave communication networks and outperforms GreedyNoSched and the SCA-based method. It also shows that the GBLinks model can generalize to varying densities and coverage regions of ultra-dense D2D mmWave communication networks.


title: DL-AMP and DBTO: An Automatic Merge Planning and Trajectory Optimization and Its Application in Autonomous Driving

abstract: This paper presents an automatic merging algorithm for autonomous driving vehicles, which decouples the specific motion planning problem into a Dual-Layer Automatic Merge Planning (DL_AMP) and a Descent-Based Trajectory Optimization (DBTO). This work leads to great improvements in finding the best merge opportunity, lateral and longitudinal merge planning and control, trajectory postprocessing and driving comfort.


title: A refinement of B\'ezout's Lemma, and order 3 elements in some quaternion algebras over $\mathbb{Q}$

abstract: Given coprime positive integers $d',d''$, B\'ezout's Lemma tells us that there are integers $u,v$ so that $d'u-d''v=1$. We show that, interchanging $d'$ and $d''$ if necessary, we may choose $u$ and $v$ to be Loeschian numbers, i.e., of the form $|\alpha|^2$, where $\alpha\in\mathbb{Z}[j]$, the ring of integers of the number field $\mathbb{Q}(j)$, where $j^2+j+1=0$. We do this by using Atkin-Lehner elements in some quaternion algebras $\mathcal{H}$. We use this fact to count the number of conjugacy classes of elements of order 3 in an order $\mathcal{O}\subset\mathcal{H}$.


title: Deep Visual Attention-Based Transfer Clustering

abstract: In this paper, we propose a methodology to improvise the technique of deep transfer clustering (DTC) when applied to the less variant data distribution. Clustering can be considered as the most important unsupervised learning problem. A simple definition of clustering can be stated as "the process of organizing objects into groups, whose members are similar in some way". Image clustering is a crucial but challenging task in the domain machine learning and computer vision. We have discussed the clustering of the data collection where the data is less variant. We have discussed the improvement by using attention-based classifiers rather than regular classifiers as the initial feature extractors in the deep transfer clustering. We have enforced the model to learn only the required region of interest in the images to get the differentiable and robust features that do not take into account the background. This paper is the improvement of the existing deep transfer clustering for less variant data distribution.


title: Enhanced Universal Dependency Parsing with Automated Concatenation of Embeddings

abstract: This paper describes the system used in submission from SHANGHAITECH team to the IWPT 2021 Shared Task. Our system is a graph-based parser with the technique of Automated Concatenation of Embeddings (ACE). Because recent work found that better word representations can be obtained by concatenating different types of embeddings, we use ACE to automatically find the better concatenation of embeddings for the task of enhanced universal dependencies. According to official results averaged on 17 languages, our system ranks 2nd over 9 teams.


title: Testing for the Presence of Structural Change and Spatial Heterogeneity

abstract: In a spatial-temporal model, structural change and/or spatial heterogeneity can easily affect estimation of parameters. Following the spatial-temporal model in [1], we develop a nonparametric procedure for test-ing the presence of structural change and spatial heterogeneity using bootstrap techniques and the forward search algorithm. The time series bootstrap can filter the effect of temporary structural change in the con-struction of a confidence interval for the temporal parameter. The forward search will also facilitate the construction of a robust confidence interval for the spatial parameter. These confidence intervals are then used in deciding on the null hypothesis that there is no structural change/spatial heterogeneity. Simulation studies illustrate the ability of the proposed test procedure in detecting presence of structural change and spatial heterogeneity under certain conditions.


title: Probabilistic Graph Reasoning for Natural Proof Generation

abstract: In this paper, we investigate the problem of reasoning over natural language statements. Prior neural based approaches do not explicitly consider the inter-dependency among answers and their proofs. In this paper, we propose PRobr, a novel approach for joint answer prediction and proof generation. PRobr defines a joint probabilistic distribution over all possible proof graphs and answers via an induced graphical model. We then optimize the model using variational approximation on top of neural textual representation. Experiments on multiple datasets under diverse settings (fully supervised, few-shot and zero-shot evaluation) verify the effectiveness of PRobr, e.g., achieving 10%-30% improvement on QA accuracy in few/zero-shot evaluation. Our codes and models can be found at https://github.com/changzhisun/PRobr/.


title: Subdiffusion equation with Caputo fractional derivative with respect to another function in modelling diffusion in a complex system consisting of matrix and channels

abstract: Diffusion equation with a fractional Caputo time derivative with respect to another function $g$, which defines new time scale of the process, is applied to describe anomalous diffusion of antibiotic (colistin) in a system consisting of packed gel (alginate) beads immersed in water and impregnated with the antibiotic. We show that ultraslow diffusion of colistin in the system occurs. The equation, which is more general than the "ordinary" fractional subdiffusion equation, can be widely used in various fields of science to model diffusion in a matrix with channels system when subdiffusion parameters and even a type of diffusion evolves over time.


title: Towards Just-Enough Documentation for Agile Effort Estimation: What Information Should Be Documented?

abstract: Effort estimation is an integral part of activities planning in Agile iterative development. An Agile team estimates the effort of a task based on the available information which is usually conveyed through documentation. However, as documentation has a lower priority in Agile, little is known about how documentation effort can be optimized while achieving accurate estimation. Hence, to help practitioners achieve just-enough documentation for effort estimation, we investigated the different types of documented information that practitioners considered useful for effort estimation. We conducted a survey study with 121 Agile practitioners across 25 countries. Our survey results showed that (1) despite the lower priority of documentation in Agile practices, 98% of the respondents considered documented information moderately to extremely important when estimating effort, (2) 73% of them reported that they would re-estimate a task when the documented information was changed, and (3) functional requirements, user stories, definition of done, UI wireframes, acceptance criteria, and task dependencies were ranked as the most useful types of documented information for effort estimation. Nevertheless, many respondents reported that these useful types of documented information were occasionally changing or missing. Based on our study results, we provide recommendations for agile practitioners on how effort estimation can be improved by focusing on just-enough documentation.


title: An NLG pipeline for a legal expert system: a work in progress

abstract: We present the NLG component for L4, a prototype domain-specific language (DSL) for drafting laws and contracts. As a concrete use case, we describe a pipeline for a legal expert system created from L4 code. The NLG component is used in two steps. The first step is to create an interview, whose answers are processed into a query for an automated reasoner. The second step is to render the answers of the reasoner in natural language.


title: Equivariant bifurcation, quadratic equivariants, and symmetry breaking for the standard representation of $S_n$

abstract: Motivated by questions originating from the study of a class of shallow student-teacher neural networks, methods are developed for the analysis of spurious minima in classes of gradient equivariant dynamics related to neural nets. In the symmetric case, methods depend on the generic equivariant bifurcation theory of irreducible representations of the symmetric group on $n$ symbols, $S_n$; in particular, the standard representation of $S_n$. It is shown that spurious minima do not arise from spontaneous symmetry breaking but rather through a complex deformation of the landscape geometry that can be encoded by a generic $S_n$-equivariant bifurcation. We describe minimal models for forced symmetry breaking that give a lower bound on the dynamic complexity involved in the creation of spurious minima when there is no symmetry. Results on generic bifurcation when there are quadratic equivariants are also proved; this work extends and clarifies results of Ihrig & Golubitsky and Chossat, Lauterback & Melbourne on the instability of solutions when there are quadratic equivariants.


title: Improving Text-to-Image Synthesis Using Contrastive Learning

abstract: The goal of text-to-image synthesis is to generate a visually realistic image that matches a given text description. In practice, the captions annotated by humans for the same image have large variance in terms of contents and the choice of words. The linguistic discrepancy between the captions of the identical image leads to the synthetic images deviating from the ground truth. To address this issue, we propose a contrastive learning approach to improve the quality and enhance the semantic consistency of synthetic images. In the pretraining stage, we utilize the contrastive learning approach to learn the consistent textual representations for the captions corresponding to the same image. Furthermore, in the following stage of GAN training, we employ the contrastive learning method to enhance the consistency between the generated images from the captions related to the same image. We evaluate our approach over two popular text-to-image synthesis models, AttnGAN and DM-GAN, on datasets CUB and COCO, respectively. Experimental results have shown that our approach can effectively improve the quality of synthetic images in terms of three metrics: IS, FID and R-precision. Especially, on the challenging COCO dataset, our approach boosts the FID signifcantly by 29.60% over AttnGAN and by 21.96% over DM-GAN.


title: Scale for codimension growth of Poisson PI-algebras

abstract: A.Regev proved that the codimension growth of an associative PI-algebra is at most exponential. The author established a scale for the codimension growth of Lie PI-algebras, which includes a series of functions between exponential and factorial functions. We prove that the same scale stratifies the ordinary codimension growth of Poisson PI-algebras satisfying Lie identical relations. As a byproduct, we obtain a new bound on the codimension growth of Lie PI-algebras in terms of complexity functions. We also study very fast codimension growth of some Poisson algebras without Lie identities. We essentially use techniques of exponential generating functions and growth of respective fast growing entire functions.


title: GradDiv: Adversarial Robustness of Randomized Neural Networks via Gradient Diversity Regularization

abstract: Deep learning is vulnerable to adversarial examples. Many defenses based on randomized neural networks have been proposed to solve the problem, but fail to achieve robustness against attacks using proxy gradients such as the Expectation over Transformation (EOT) attack. We investigate the effect of the adversarial attacks using proxy gradients on randomized neural networks and demonstrate that it highly relies on the directional distribution of the loss gradients of the randomized neural network. We show in particular that proxy gradients are less effective when the gradients are more scattered. To this end, we propose Gradient Diversity (GradDiv) regularizations that minimize the concentration of the gradients to build a robust randomized neural network. Our experiments on MNIST, CIFAR10, and STL10 show that our proposed GradDiv regularizations improve the adversarial robustness of randomized neural networks against a variety of state-of-the-art attack methods. Moreover, our method efficiently reduces the transferability among sample models of randomized neural networks.


title: Sustaining Performance While Reducing Energy Consumption: A Control Theory Approach

abstract: Production high-performance computing systems continue to grow in complexity and size. As applications struggle to make use of increasingly heterogeneous compute nodes, maintaining high efficiency (performance per watt) for the whole platform becomes a challenge. Alongside the growing complexity of scientific workloads, this extreme heterogeneity is also an opportunity: as applications dynamically undergo variations in workload, due to phases or data/compute movement between devices, one can dynamically adjust power across compute elements to save energy without impacting performance. With an aim toward an autonomous and dynamic power management strategy for current and future HPC architectures, this paper explores the use of control theory for the design of a dynamic power regulation method. Structured as a feedback loop, our approach-which is novel in computing resource management-consists of periodically monitoring application progress and choosing at runtime a suitable power cap for processors. Thanks to a preliminary offline identification process, we derive a model of the dynamics of the system and a proportional-integral (PI) controller. We evaluate our approach on top of an existing resource management framework, the Argo Node Resource Manager, deployed on several clusters of Grid'5000, using a standard memory-bound HPC benchmark.


title: Dynamical System Parameter Identification using Deep Recurrent Cell Networks

abstract: In this paper, we investigate the parameter identification problem in dynamical systems through a deep learning approach. Focusing mainly on second-order, linear time-invariant dynamical systems, the topic of damping factor identification is studied. By utilizing a six-layer deep neural network with different recurrent cells, namely GRUs, LSTMs or BiLSTMs; and by feeding input-output sequence pairs captured from a dynamical system simulator, we search for an effective deep recurrent architecture in order to resolve damping factor identification problem. Our study results show that, although previously not utilized for this task in the literature, bidirectional gated recurrent cells (BiLSTMs) provide better parameter identification results when compared to unidirectional gated recurrent memory cells such as GRUs and LSTM. Thus, indicating that an input-output sequence pair of finite length, collected from a dynamical system and when observed anachronistically, may carry information in both time directions for prediction of a dynamical systems parameter.


title: Browder's Theorem through Brouwer's Fixed Point Theorem

abstract: One of the conclusions of Browder (1960) is a parametric version of Brouwer's Fixed Point Theorem, stating that for every continuous function $f : ([0,1] \times X) \to X$, where $X$ is a simplex in a Euclidean space, the set of fixed points of $f$, namely, the set $\{(t,x) \in [0,1] \times X \colon f(t,x) = x\}$, has a connected component whose projection on the first coordinate is $[0,1]$. Browder's (1960) proof relies on the theory of the fixed point index. We provide an alternative proof to Browder's result using Brouwer's Fixed Point Theorem.


title: STDP-based Associative Memory Formation and Retrieval

abstract: Spike-timing-dependent plasticity(STDP) is a biological process in which the precise order and timing of neuronal spikes affect the degree of synaptic modification. While there have been numerous research focusing on the role of STDP in neural coding, the functional implications of STDP at the macroscopic level in the brain have not been fully explored yet. In this work, we propose a neurodynamical model based on STDP that renders storage and retrieval of a group of associative memories. We showed that the function of STDP at the macroscopic level is to form a "memory plane" in the neural state space which dynamically encodes high dimensional data. We derived the analytic relation between the input, the memory plane, and the induced macroscopic neural oscillations around the memory plane. Such plane produces a limit cycle in reaction to a similar memory cue, which can be used for retrieval of the original input.


title: Metapopulation dynamics of a respiratory disease with infection during travel

abstract: We formulate a compartmental model for the propagation of a respiratory disease in a patchy environment. The patches are connected through the mobility of individuals, and we assume that disease transmission and recovery are possible during travel. Moreover, the migration terms are assumed to depend on the distance between patches and the perceived severity of the disease. The positivity and boundedness of the model solutions are discussed. We analytically show the existence and global asymptotic stability of the disease-free equilibrium. We study three different network topologies numerically and find that underlying network structure is crucial for disease transmission. Further numerical simulations reveal that infection during travel has the potential to change the stability of disease-free equilibrium from stable to unstable. The coupling strength and transmission coefficients are also very crucial in disease propagation. Different exit screening scenarios indicate that the patch with the highest prevalence may have adverse effects but other patches will be benefited from exit screening. Furthermore, while studying the multi-strain dynamics, it is observed that two co-circulating strains will not persist simultaneously in the community but only one of the strains may persist in the long run. Transmission coefficients corresponding to the second strain are very crucial and show threshold like behavior with respect to the equilibrium density of the second strain.


title: Bayesian Nonparametric Modelling for Model-Free Reinforcement Learning in LTE-LAA and Wi-Fi Coexistence

abstract: With the arrival of next generation wireless communication, a growing number of new applications like internet of things, autonomous driving systems, and drone are crowding the unlicensed spectrum. Licensed network such as the long-term evolution (LTE) also comes to the unlicensed spectrum for better providing high-capacity contents with low cost. However, LTE was not designed to share resources with others. Previous solutions usually work on fixed scenarios. This work features a Nonparametric Bayesian reinforcement learning algorithm to cope with the coexistence between Wi-Fi and LTE licensed assisted access (LTE-LAA) agents in 5 GHz unlicensed spectrum. The coexistence problem is modeled as a decentralized partially-observable Markov decision process (Dec-POMDP) and Bayesian inference is adopted for policy learning with nonparametric prior to accommodate the uncertainty of policy for different agents. A fairness measure is introduced in the reward function to encourage fair sharing between agents. Variational inference for posterior model approximation is considered to make the algorithm computationally efficient. Simulation results demonstrate that this algorithm can reach high value with compact policy representations in few learning iterations.


title: Unifying Width-Reduced Methods for Quasi-Self-Concordant Optimization

abstract: We provide several algorithms for constrained optimization of a large class of convex problems, including softmax, $\ell_p$ regression, and logistic regression. Central to our approach is the notion of width reduction, a technique which has proven immensely useful in the context of maximum flow [Christiano et al., STOC'11] and, more recently, $\ell_p$ regression [Adil et al., SODA'19], in terms of improving the iteration complexity from $O(m^{1/2})$ to $\tilde{O}(m^{1/3})$, where $m$ is the number of rows of the design matrix, and where each iteration amounts to a linear system solve. However, a considerable drawback is that these methods require both problem-specific potentials and individually tailored analyses. As our main contribution, we initiate a new direction of study by presenting the first unified approach to achieving $m^{1/3}$-type rates. Notably, our method goes beyond these previously considered problems to more broadly capture quasi-self-concordant losses, a class which has recently generated much interest and includes the well-studied problem of logistic regression, among others. In order to do so, we develop a unified width reduction method for carefully handling these losses based on a more general set of potentials. Additionally, we directly achieve $m^{1/3}$-type rates in the constrained setting without the need for any explicit acceleration schemes, thus naturally complementing recent work based on a ball-oracle approach [Carmon et al., NeurIPS'20].


title: Double-Uncertainty Guided Spatial and Temporal Consistency Regularization Weighting for Learning-based Abdominal Registration

abstract: In order to tackle the difficulty associated with the ill-posed nature of the image registration problem, regularization is often used to constrain the solution space. For most learning-based registration approaches, the regularization usually has a fixed weight and only constrains the spatial transformation. Such convention has two limitations: (i) Besides the laborious grid search for the optimal fixed weight, the regularization strength of a specific image pair should be associated with the content of the images, thus the "one value fits all" training scheme is not ideal; (ii) Only spatially regularizing the transformation may neglect some informative clues related to the ill-posedness. In this study, we propose a mean-teacher based registration framework, which incorporates an additional temporal consistency regularization term by encouraging the teacher model's prediction to be consistent with that of the student model. More importantly, instead of searching for a fixed weight, the teacher enables automatically adjusting the weights of the spatial regularization and the temporal consistency regularization by taking advantage of the transformation uncertainty and appearance uncertainty. Extensive experiments on the challenging abdominal CT-MRI registration show that our training strategy can promisingly advance the original learning-based method in terms of efficient hyperparameter tuning and a better tradeoff between accuracy and smoothness.


title: Self-Adversarial Training incorporating Forgery Attention for Image Forgery Localization

abstract: Image editing techniques enable people to modify the content of an image without leaving visual traces and thus may cause serious security risks. Hence the detection and localization of these forgeries become quite necessary and challenging. Furthermore, unlike other tasks with extensive data, there is usually a lack of annotated forged images for training due to annotation difficulties. In this paper, we propose a self-adversarial training strategy and a reliable coarse-to-fine network that utilizes a self-attention mechanism to localize forged regions in forgery images. The self-attention module is based on a Channel-Wise High Pass Filter block (CW-HPF). CW-HPF leverages inter-channel relationships of features and extracts noise features by high pass filters. Based on the CW-HPF, a self-attention mechanism, called forgery attention, is proposed to capture rich contextual dependencies of intrinsic inconsistency extracted from tampered regions. Specifically, we append two types of attention modules on top of CW-HPF respectively to model internal interdependencies in spatial dimension and external dependencies among channels. We exploit a coarse-to-fine network to enhance the noise inconsistency between original and tampered regions. More importantly, to address the issue of insufficient training data, we design a self-adversarial training strategy that expands training data dynamically to achieve more robust performance. Specifically, in each training iteration, we perform adversarial attacks against our network to generate adversarial examples and train our model on them. Extensive experimental results demonstrate that our proposed algorithm steadily outperforms state-of-the-art methods by a clear margin in different benchmark datasets.


title: Dynamical properties of max-plus equations obtained from tropically discretized Sel'kov model

abstract: Max-plus equations are derived from tropically discretized Sel'kov model via ultradiscretization. These max-plus equations possess common dynamical structures with the discretized model: Neimark-Sacker bifurcation and limit cycles. The limit cycles of the ultradiscrete max-plus equations have seven discrete states. Furthermore, these max-plus equations exhibit excitability. Relationship between the tropically discretized model and the derived max-plus equations is also discussed based on numerical results. It is found that the derived max-plus equations correspond to a limiting case of the tropically discretized model.


title: Feedback controllability for blowup points of heat equation

abstract: This paper concerns a controllability problem for blowup points on heat equation. It can be described as follows: In the absence of control, the solution to the linear heat system globally exists in a bounded domain $\Omega$. While, for a given time $T>0$ and a point $a$ in this domain, we find a feedback control, which is acted on an internal subset $\omega$ of this domain, such that the corresponding solution to this system blows up at time $T$ and holds unique point $a$. We show that $a\in \omega$ can be the unique blowup point of the corresponding solution with a certain feedback control, and for any feedback control, $a\in \Omega\setminus \overline{\omega}$ could not be the unique blowup point.


title: Turbo Coded Single User Massive MIMO

abstract: This work deals with turbo coded single user massive multiple input multiple output (SU-MMIMO) systems, with and without precoding. SU-MMIMO has a much higher spectral efficiency compared to multi-user massive MIMO (MU-MMIMO) since independent signals are transmitted from each of the antenna elements (spatial multiplexing). MU-MMIMO that uses beamforming has a much lower spectral efficiency, since the same signal (with a delay) is transmitted from each of the antenna elements. In this work, expressions for the upper bound on the average signal-to-noise ratio (SNR) per bit and spectral efficiency are derived for SU-MMIMO with and without precoding. We propose a performance index $f(N_t)$, which is a function of the number of transmit antennas $N_t$. Here $f(N_t)$ is the sum of the upper bound on the average SNR per bit and the spectral efficiency. We demonstrate that when the total number of antennas ($N_{\mathrm{tot}}$) in the transmitter and receiver is fixed, there exists a minimum value of $f(N_t)$, which has to be avoided. Computer simulations show that the bit-error-rate (BER) is nearly insensitive to a wide range of the number of transmit antennas and re-transmissions, when $N_{\mathrm{tot}}$ is large and kept constant. Thus, the spectral efficiency can be made as large as possible, for a given BER and $N_{\mathrm{tot}}$.


title: Shell Language Processing: Unix command parsing for Machine Learning

abstract: In this article, we present a Shell Language Preprocessing (SLP) library, which implements tokenization and encoding directed at parsing Unix and Linux shell commands. We describe the rationale behind the need for a new approach with specific examples of when conventional Natural Language Processing (NLP) pipelines fail. Furthermore, we evaluate our methodology on a security classification task against widely accepted information and communications technology (ICT) tokenization techniques and achieve significant improvement of an F1 score from 0.392 to 0.874.


title: Goodness-of-fit testing for H\"older continuous densities under local differential privacy

abstract: We address the problem of goodness-of-fit testing for H\"older continuous densities under local differential privacy constraints. We study minimax separation rates when only non-interactive privacy mechanisms are allowed to be used and when both non-interactive and sequentially interactive can be used for privatisation. We propose privacy mechanisms and associated testing procedures whose analysis enables us to obtain upper bounds on the minimax rates. These results are complemented with lower bounds. By comparing these bounds, we show that the proposed privacy mechanisms and tests are optimal up to at most a logarithmic factor for several choices of $f_0$ including densities from uniform, normal, Beta, Cauchy, Pareto, exponential distributions. In particular, we observe that the results are deteriorated in the private setting compared to the non-private one. Moreover, we show that sequentially interactive mechanisms improve upon the results obtained when considering only non-interactive privacy mechanisms.


title: A Hierarchical Dual Model of Environment- and Place-Specific Utility for Visual Place Recognition

abstract: Visual Place Recognition (VPR) approaches have typically attempted to match places by identifying visual cues, image regions or landmarks that have high ``utility'' in identifying a specific place. But this concept of utility is not singular - rather it can take a range of forms. In this paper, we present a novel approach to deduce two key types of utility for VPR: the utility of visual cues `specific' to an environment, and to a particular place. We employ contrastive learning principles to estimate both the environment- and place-specific utility of Vector of Locally Aggregated Descriptors (VLAD) clusters in an unsupervised manner, which is then used to guide local feature matching through keypoint selection. By combining these two utility measures, our approach achieves state-of-the-art performance on three challenging benchmark datasets, while simultaneously reducing the required storage and compute time. We provide further analysis demonstrating that unsupervised cluster selection results in semantically meaningful results, that finer grained categorization often has higher utility for VPR than high level semantic categorization (e.g. building, road), and characterise how these two utility measures vary across different places and environments. Source code is made publicly available at https://github.com/Nik-V9/HEAPUtil.


title: The characteristic gluing problem for the Einstein equations and applications

abstract: In this paper we introduce the characteristic gluing problem for the Einstein vacuum equations. We present a codimension-$10$ gluing construction for characteristic initial data which are close to the Minkowski data and we show that the $10$-dimensional obstruction space consists of gauge-invariant charges which are conserved by the linearized null constraint equations. By relating these $10$ charges to the ADM energy, linear momentum, angular momentum and the center-of-mass we prove that asymptotically flat data can be characteristically glued (including the $10$ charges) to the data of a suitably chosen Kerr spacetime, obtaining as a corollary an alternative proof of the Corvino--Schoen spacelike gluing construction. Moreover, we derive a localized version of our construction where the given data restricted on an angular sector is characteristically glued to the Minkowski data restricted on another angular sector. As a corollary we obtain an alternative proof of the Carlotto-Schoen localized spacelike gluing construction. Our method yields no loss of decay in the transition region, resolving an open problem. We also discuss a number of other applications.


title: Early Recognition of Ball Catching Success in Clinical Trials with RNN-Based Predictive Classification

abstract: Motor disturbances can affect the interaction with dynamic objects, such as catching a ball. A classification of clinical catching trials might give insight into the existence of pathological alterations in the relation of arm and ball movements. Accurate, but also early decisions are required to classify a catching attempt before the catcher's first ball contact. To obtain clinically valuable results, a significant decision confidence of at least 75% is required. Hence, three competing objectives have to be optimized at the same time: accuracy, earliness and decision-making confidence. Here we propose a coupled classification and prediction approach for early time series classification: a predictive, generative recurrent neural network (RNN) forecasts the next data points of ball trajectories based on already available observations; a discriminative RNN continuously generates classification guesses based on the available data points and the unrolled sequence predictions. We compare our approach, which we refer to as predictive sequential classification (PSC), to state-of-the-art sequence learners, including various RNN and temporal convolutional network (TCN) architectures. On this hard real-world task we can consistently demonstrate the superiority of PSC over all other models in terms of accuracy and confidence with respect to earliness of recognition. Specifically, PSC is able to confidently classify the success of catching trials as early as 123 milliseconds before the first ball contact. We conclude that PSC is a promising approach for early time series classification, when accurate and confident decisions are required.


title: Universal relation between the variances of distortions of gravitational waves owing to gravitational lensing

abstract: Gravitational waves from the distant sources are gravitationally lensed during their propagation through the intervening matter inhomogeneities before arriving at detectors. It has been proposed in the literature that the variance of the lensed waveform can be used to extract information of the matter power spectrum at very small scales and of low-mass dark halos. In this paper, we show that the variance of the amplitude fluctuation and that of the phase fluctuation of the lensed waveform obey a simple relation irrespective of the shape of the matter power spectrum. We study conditions under which this relation can be violated and discuss some potential applications of the relation. This relation may be used to confirm the robustness of claimed observations of gravitational lensing of gravitational waves and the subsequent reconstruction of the matter power spectrum.


title: The NiuTrans End-to-End Speech Translation System for IWSLT 2021 Offline Task

abstract: This paper describes the submission of the NiuTrans end-to-end speech translation system for the IWSLT 2021 offline task, which translates from the English audio to German text directly without intermediate transcription. We use the Transformer-based model architecture and enhance it by Conformer, relative position encoding, and stacked acoustic and textual encoding. To augment the training data, the English transcriptions are translated to German translations. Finally, we employ ensemble decoding to integrate the predictions from several models trained with the different datasets. Combining these techniques, we achieve 33.84 BLEU points on the MuST-C En-De test set, which shows the enormous potential of the end-to-end model.


title: Generalised holonomies and K(E$_9$)

abstract: The involutory subalgebra K(E$_9$) of the affine Kac-Moody algebra E$_9$ was recently shown to admit an infinite sequence of unfaithful representations of ever increasing dimensions arXiv:2102.00870. We revisit these representations and describe their associated ideals in more detail, with particular emphasis on two chiral versions that can be constructed for each such representation. For every such unfaithful representation we show that the action of K(E$_9$) decomposes into a direct sum of two mutually commuting (`chiral' and `anti-chiral') parabolic algebras with Levi subalgebra $\mathfrak{so}(16)_+\,\oplus\,\mathfrak{so}(16)_-$. We also spell out the consistency conditions for uplifting such representations to unfaithful representations of K(E$_{10}$). From these results it is evident that the holonomy groups so far discussed in the literature are mere shadows (in a Platonic sense) of a much larger structure.


title: Two new classes of projective two-weight linear codes

abstract: In this paper, for an odd prime $p$, several classes of two-weight linear codes over the finite field $\mathbb{F}_p$ are constructed from the defining sets, and then their complete weight distributions are determined by employing character sums. These codes can be suitable for applications in secret sharing schemes. Furthermore, two new classes of projective two-weight codes are obtained, and then two new classes of strongly regular graphs are given.


title: Complete weight enumerators for several classes of two-weight and three-weight linear codes

abstract: In this paper, for an odd prime $p$, by extending Li et al.'s construction \cite{CL2016}, several classes of two-weight and three-weight linear codes over the finite field $\mathbb{F}_p$ are constructed from a defining set, and then their complete weight enumerators are determined by using Weil sums. Furthermore, we show that some examples of these codes are optimal or almost optimal with respect to the Griesmer bound. Our results generalize the corresponding results in \cite{CL2016, GJ2019}.


title: Non-Abelian Half-Quantum Vortices in ${}^{3}P_{2}$ Topological Superfluids

abstract: ${}^{3}P_{2}$ superfluids realized in neutron stars are the largest topological quantum matters in our Universe. We establish the existence and stability of non-Abelian half-quantum vortices (HQVs) in ${}^{3}P_{2}$ superfluids with strong magnetic fields. Using a self-consistent microscopic approach, we find that a singly quantized vortex is energetically destabilized into a pair of two non-Abelian HQVs owing to the strongly spin-orbit-coupled pairing. We find a topologically protected Majorana fermion on each HQV, thereby providing two-fold non-Abelian anyons characterized by both Majorana fermions and a non-Abelian first homotopy group.


title: The characteristic gluing problem for the Einstein vacuum equations. Linear and non-linear analysis

abstract: This is the second paper in a series of papers adressing the characteristic gluing problem for the Einstein vacuum equations. We solve the codimension-$10$ characteristic gluing problem for characteristic data which are close to the Minkowski data. We derive an infinite-dimensional space of gauge-dependent charges and a $10$-dimensional space of gauge-invariant charges that are conserved by the linearized null constraint equations and act as obstructions to the gluing problem. The gauge-dependent charges can be matched by applying angular and transversal gauge transformations of the characteristic data. By making use of a special hierarchy of radial weights of the null constraint equations, we construct the null lapse function and the conformal geometry of the characteristic hypersurface, and we show that the aforementioned charges are in fact the only obstructions to the gluing problem. Modulo the gauge-invariant charges, the resulting solution of the null constraint equations is $C^{m+2}$ for any specified integer $m\geq0$ in the tangential directions and $C^2$ in the transversal directions to the characteristic hypersurface. We also show that higher-order (in all directions) gluing is possible along bifurcated characteristic hypersurfaces (modulo the gauge-invariant charges).


title: End-To-End Data-Dependent Routing in Multi-Path Neural Networks

abstract: Neural networks are known to give better performance with increased depth due to their ability to learn more abstract features. Although the deepening of networks has been well established, there is still room for efficient feature extraction within a layer which would reduce the need for mere parameter increment. The conventional widening of networks by having more filters in each layer introduces a quadratic increment of parameters. Having multiple parallel convolutional/dense operations in each layer solves this problem, but without any context-dependent allocation of resources among these operations: the parallel computations tend to learn similar features making the widening process less effective. Therefore, we propose the use of multi-path neural networks with data-dependent resource allocation among parallel computations within layers, which also lets an input to be routed end-to-end through these parallel paths. To do this, we first introduce a cross-prediction based algorithm between parallel tensors of subsequent layers. Second, we further reduce the routing overhead by introducing feature-dependent cross-connections between parallel tensors of successive layers. Our multi-path networks show superior performance to existing widening and adaptive feature extraction, and even ensembles, and deeper networks at similar complexity in the image recognition task.


title: Integrating Large Circular Kernels into CNNs through Neural Architecture Search

abstract: The square kernel is a standard unit for contemporary CNNs, as it fits well on the tensor computation for convolution operation. However, the retinal ganglion cells in the biological visual system have approximately concentric receptive fields. Motivated by this observation, we propose to use circular kernel with a concentric and isotropic receptive field as an option for the convolution operation. We first propose a simple yet efficient implementation of the convolution using circular kernels, and empirically show the significant advantages of large circular kernels over the counterpart square kernels. We then expand the operation space of several typical Neural Architecture Search (NAS) methods with the convolutions of large circular kernels. The searched new neural architectures do contain large circular kernels and outperform the original searched models considerably. Our additional analysis also reveals that large circular kernels could help the model to be more robust to the rotated or sheared images due to their better rotation invariance. Our work shows the potential of designing new convolutional kernels for CNNs, bringing up the prospect of expanding the search space of NAS with new variants of convolutions.


title: Fast-Learning Grasping and Pre-Grasping via Clutter Quantization and Q-map Masking

abstract: Grasping objects in cluttered scenarios is a challenging task in robotics. Performing pre-grasp actions such as pushing and shifting to scatter objects is a way to reduce clutter. Based on deep reinforcement learning, we propose a Fast-Learning Grasping (FLG) framework, that can integrate pre-grasping actions along with grasping to pick up objects from cluttered scenarios with reduced real-world training time. We associate rewards for performing moving actions with the change of environmental clutter and utilize a hybrid triggering method, leading to data-efficient learning and synergy. Then we use the output of an extended fully convolutional network as the value function of each pixel point of the workspace and establish an accurate estimation of the grasp probability for each action. We also introduce a mask function as prior knowledge to enable the agents to focus on the accurate pose adjustment to improve the effectiveness of collecting training data and, hence, to learn efficiently. We carry out pre-training of the FLG over simulated environment, and then the learnt model is transferred to the real world with minimal fine-tuning for further learning during actions. Experimental results demonstrate a 94% grasp success rate and the ability to generalize to novel objects. Compared to state-of-the-art approaches in the literature, the proposed FLG framework can achieve similar or higher grasp success rate with lesser amount of training in the real world. Supplementary video is available at https://youtu.be/e04uDLsxfDg.


title: Neural Mixture Models with Expectation-Maximization for End-to-end Deep Clustering

abstract: Any clustering algorithm must synchronously learn to model the clusters and allocate data to those clusters in the absence of labels. Mixture model-based methods model clusters with pre-defined statistical distributions and allocate data to those clusters based on the cluster likelihoods. They iteratively refine those distribution parameters and member assignments following the Expectation-Maximization (EM) algorithm. However, the cluster representability of such hand-designed distributions that employ a limited amount of parameters is not adequate for most real-world clustering tasks. In this paper, we realize mixture model-based clustering with a neural network where the final layer neurons, with the aid of an additional transformation, approximate cluster distribution outputs. The network parameters pose as the parameters of those distributions. The result is an elegant, much-generalized representation of clusters than a restricted mixture of hand-designed distributions. We train the network end-to-end via batch-wise EM iterations where the forward pass acts as the E-step and the backward pass acts as the M-step. In image clustering, the mixture-based EM objective can be used as the clustering objective along with existing representation learning methods. In particular, we show that when mixture-EM optimization is fused with consistency optimization, it improves the sole consistency optimization performance in clustering. Our trained networks outperform single-stage deep clustering methods that still depend on k-means, with unsupervised classification accuracy of 63.8% in STL10, 58% in CIFAR10, 25.9% in CIFAR100, and 98.9% in MNIST.


title: Coexistence of diffusive and ballistic transport in integrable quantum lattice models

abstract: We investigate the high-temperature dynamical conductivity $\sigma(\omega)$ in two one-dimensional integrable quantum lattice models: the anisotropic XXZ spin chain and the Hubbard chain. The emphasis is on the metallic regime of both models, where besides the ballistic component, the regular part of conductivity might reveal a diffusive-like transport. To resolve the low-frequency dynamics, we upgrade the microcanonical Lanczos method enabling studies of finite-size systems with up to $L\leq 32$ sites for XXZ spin model with the frequency resolution $\delta \omega \sim 10^{-3} J$. Results for the XXZ chain reveal a fine structure of $\sigma(\omega)$ spectra, which originates from the discontinuous variation of the stiffness, previously found at commensurate values of the anisotropy parameter $\Delta$. Still, we do not find a clear evidence for a diffusive component, at least not for commensurate values of $\Delta$, particularly for $\Delta =0.5$, as well as for $\Delta \to 0$. Similar is the conclusion for the Hubbard model away from half-filling, where the spectra reveal more universal behavior.


title: Assessing the Performance of an Adaptive Multi-Fidelity Gaussian Process with Noisy Training Data: A Statistical Analysis

abstract: Despite the increased computational resources, the simulation-based design optimization (SBDO) procedure can be very expensive from a computational viewpoint, especially if high-fidelity solvers are required. Multi-fidelity metamodels have been successfully applied to reduce the computational cost of the SBDO process. In this context, the paper presents the performance assessment of an adaptive multi-fidelity metamodel based on a Gaussian process regression (MF-GPR) for noisy data. The MF-GPR is developed to: (i) manage an arbitrary number of fidelity levels, (ii) deal with objective function evaluations affected by noise, and (iii) improve its fitting accuracy by adaptive sampling. Multi-fidelity is achieved by bridging a low-fidelity metamodel with metamodels of the error between successive fidelity levels. The MF-GPR handles the numerical noise through regression. The adaptive sampling method is based on the maximum prediction uncertainty and includes rules to automatically select the fidelity to sample. The MF-GPR performance are assessed on a set of five analytical benchmark problems affected by noisy objective function evaluations. Since the noise introduces randomness in the evaluation of the objective function, a statistical analysis approach is adopted to assess the performance and the robustness of the MF-GPR. The paper discusses the efficiency and effectiveness of the MF-GPR in globally approximating the objective function and identifying the global minimum. One, two, and three fidelity levels are used. The results of the statistical analysis show that the use of three fidelity levels achieves a more accurate global representation of the noise-free objective function compared to the use of one or two fidelities.


title: Characteristic gluing to the Kerr family and application to spacelike gluing

abstract: This is the third paper in a series of papers adressing the characteristic gluing problem for the Einstein vacuum equations. We provide full details of our characteristic gluing (including the $10$ charges) of strongly asymptotically flat data to the data of a suitably chosen Kerr spacetime. The choice of the Kerr spacetime crucially relies on relating the $10$ charges to the ADM energy, linear momentum, angular momentum and the center-of-mass. As a corollary, we obtain an alternative proof of the Corvino-Schoen spacelike gluing construction for strongly asymptotically flat spacelike initial data.


title: Comparing PCG metrics with Human Evaluation in Minecraft Settlement Generation

abstract: There are a range of metrics that can be applied to the artifacts produced by procedural content generation, and several of them come with qualitative claims. In this paper, we adapt a range of existing PCG metrics to generated Minecraft settlements, develop a few new metrics inspired by PCG literature, and compare the resulting measurements to existing human evaluations. The aim is to analyze how those metrics capture human evaluation scores in different categories, how the metrics generalize to another game domain, and how metrics deal with more complex artifacts. We provide an exploratory look at a variety of metrics and provide an information gain and several correlation analyses. We found some relationships between human scores and metrics counting specific elements, measuring the diversity of blocks and measuring the presence of crafting materials for the present complex blocks.


title: The Boltzmann equation for plane Couette flow

abstract: In the paper, we study the plane Couette flow of a rarefied gas between two parallel infinite plates at $y=\pm L$ moving relative to each other with opposite velocities $(\pm \alpha L,0,0)$ along the $x$-direction. Assuming that the stationary state takes the specific form of $F(y,v_x-\alpha y,v_y,v_z)$ with the $x$-component of the molecular velocity sheared linearly along the $y$-direction, such steady flow is governed by a boundary value problem on a steady nonlinear Boltzmann equation driven by an external shear force under the homogeneous non-moving diffuse reflection boundary condition. In case of the Maxwell molecule collisions, we establish the existence of spatially inhomogeneous non-equilibrium stationary solutions to the steady problem for any small enough shear rate $\alpha>0$ via an elaborate perturbation approach using Caflisch's decomposition together with Guo's $L^\infty\cap L^2$ theory. The result indicates the polynomial tail at large velocities for the stationary distribution. Moreover, the large time asymptotic stability of the stationary solution with an exponential convergence is also obtained and as a consequence the nonnegativity of the steady profile is justified.


title: Two-parameter estimation with three-mode NOON state in a symmetric three-well system

abstract: We propose a scheme to realize two-parameter estimation via a Bose-Einstein condensates confined in a symmetric triple-well potential. The three-mode NOON state is prepared adiabatically as the initial state. The two parameters to be estimated are the phase differences between the wells. The sensitivity of this estimation scheme is studied by comparing quantum and classical Fisher information matrices. As a result, we find an optimal particle number measurement method. Moreover, the precision of this estimation scheme behaves the Heisenberg scaling under the optimal measurement.


title: OptiMic: A tool to generate optimized polycrystalline microstructures for materials simulations

abstract: Polycrystal microstructures, with their distinct physical, chemical, structural and topological entities, play an important role in determining the effective properties of materials. Particularly for computational studies, the well-known Voronoi tessellation technique is regularly used for obtaining microstructures. Standard Voronoi tessellations, however, exhibit statistics that are generally far removed from those in real microstructures. Nevertheless, such tessellations can be optimized to obtain certain key features and statistics seen in real microstructures. In this work, we develop the open-source software package OptiMic that enables the generation of optimized microstructures for both finite element as well as atomistic simulations. OptiMic allows for both monodispersive grains as well as irregular grains obtained currently via Voronoi tessellations. These initial microstructures can then be optimized to reflect desired statistical features. A key feature of the tool is that it gives the user extensive control on the optimization process via customizable cost functions. The software currently performs tessellations with the Voronoi method and can be easily extended to include other methods like grain-growth, phase-field etc.


title: Size matters? Or not: A/B testing with limited sample in automotive embedded software

abstract: A/B testing is gaining attention in the automotive sector as a promising tool to measure causal effects from software changes. Different from the web-facing businesses, where A/B testing has been well-established, the automotive domain often suffers from limited eligible users to participate in online experiments. To address this shortcoming, we present a method for designing balanced control and treatment groups so that sound conclusions can be drawn from experiments with considerably small sample sizes. While the Balance Match Weighted method has been used in other domains such as medicine, this is the first paper to apply and evaluate it in the context of software development. Furthermore, we describe the Balance Match Weighted method in detail and we conduct a case study together with an automotive manufacturer to apply the group design method in a fleet of vehicles. Finally, we present our case study in the automotive software engineering domain, as well as a discussion on the benefits and limitations of the A/B group design method.


title: FloorLevel-Net: Recognizing Floor-Level Lines with Height-Attention-Guided Multi-task Learning

abstract: The ability to recognize the position and order of the floor-level lines that divide adjacent building floors can benefit many applications, for example, urban augmented reality (AR). This work tackles the problem of locating floor-level lines in street-view images, using a supervised deep learning approach. Unfortunately, very little data is available for training such a network $-$ current street-view datasets contain either semantic annotations that lack geometric attributes, or rectified facades without perspective priors. To address this issue, we first compile a new dataset and develop a new data augmentation scheme to synthesize training samples by harassing (i) the rich semantics of existing rectified facades and (ii) perspective priors of buildings in diverse street views. Next, we design FloorLevel-Net, a multi-task learning network that associates explicit features of building facades and implicit floor-level lines, along with a height-attention mechanism to help enforce a vertical ordering of floor-level lines. The generated segmentations are then passed to a second-stage geometry post-processing to exploit self-constrained geometric priors for plausible and consistent reconstruction of floor-level lines. Quantitative and qualitative evaluations conducted on assorted facades in existing datasets and street views from Google demonstrate the effectiveness of our approach. Also, we present context-aware image overlay results and show the potentials of our approach in enriching AR-related applications.


title: EVARS-GPR: EVent-triggered Augmented Refitting of Gaussian Process Regression for Seasonal Data

abstract: Time series forecasting is a growing domain with diverse applications. However, changes of the system behavior over time due to internal or external influences are challenging. Therefore, predictions of a previously learned fore-casting model might not be useful anymore. In this paper, we present EVent-triggered Augmented Refitting of Gaussian Process Regression for Seasonal Data (EVARS-GPR), a novel online algorithm that is able to handle sudden shifts in the target variable scale of seasonal data. For this purpose, EVARS-GPR com-bines online change point detection with a refitting of the prediction model using data augmentation for samples prior to a change point. Our experiments on sim-ulated data show that EVARS-GPR is applicable for a wide range of output scale changes. EVARS-GPR has on average a 20.8 % lower RMSE on different real-world datasets compared to methods with a similar computational resource con-sumption. Furthermore, we show that our algorithm leads to a six-fold reduction of the averaged runtime in relation to all comparison partners with a periodical refitting strategy. In summary, we present a computationally efficient online fore-casting algorithm for seasonal time series with changes of the target variable scale and demonstrate its functionality on simulated as well as real-world data. All code is publicly available on GitHub: https://github.com/grimmlab/evars-gpr.


title: Learning a Generative Transition Model for Uncertainty-Aware Robotic Manipulation

abstract: Robot learning of real-world manipulation tasks remains challenging and time consuming, even though actions are often simplified by single-step manipulation primitives. In order to compensate the removed time dependency, we additionally learn an image-to-image transition model that is able to predict a next state including its uncertainty. We apply this approach to bin picking, the task of emptying a bin using grasping as well as pre-grasping manipulation as fast as possible. The transition model is trained with up to 42000 pairs of real-world images before and after a manipulation action. Our approach enables two important skills: First, for applications with flange-mounted cameras, picks per hours (PPH) can be increased by around 15% by skipping image measurements. Second, we use the model to plan action sequences ahead of time and optimize time-dependent rewards, e.g. to minimize the number of actions required to empty the bin. We evaluate both improvements with real-robot experiments and achieve over 700 PPH in the YCB Box and Blocks Test.


title: A note on the convergence rate of Peng's law of large numbers under sublinear expectations

abstract: This short note provides a new and simple proof of the convergence rate for Peng's law of large numbers under sublinear expectations, which improves the corresponding results in Song [15] and Fang et al. [3].


title: On-edge Multi-task Transfer Learning: Model and Practice with Data-driven Task Allocation

abstract: On edge devices, data scarcity occurs as a common problem where transfer learning serves as a widely-suggested remedy. Nevertheless, transfer learning imposes a heavy computation burden to resource-constrained edge devices. Existing task allocation works usually assume all submitted tasks are equally important, leading to inefficient resource allocation at a task level when directly applied in Multi-task Transfer Learning (MTL). To address these issues, we first reveal that it is crucial to measure the impact of tasks on overall decision performance improvement and quantify \emph{task importance}. We then show that task allocation with task importance for MTL (TATIM) is a variant of the NP-complete Knapsack problem, where the complicated computation to solve this problem needs to be conducted repeatedly under varying contexts. To solve TATIM with high computational efficiency, we propose a Data-driven Cooperative Task Allocation (DCTA) approach. Finally, we evaluate the performance of DCTA by not only a trace-driven simulation, but also a new comprehensive real-world AIOps case study that bridges model and practice via a new architecture and main components design within the AIOps system. Extensive experiments show that our DCTA reduces 3.24 times of processing time, and saves 48.4\% energy consumption compared with the state-of-the-art when solving TATIM.