title: Risk-Aware Scene Sampling for Dynamic Assurance of Autonomous Systems

abstract: Autonomous Cyber-Physical Systems must often operate under uncertainties like sensor degradation and shifts in the operating conditions, which increases its operational risk. Dynamic Assurance of these systems requires designing runtime safety components like Out-of-Distribution detectors and risk estimators, which require labeled data from different operating modes of the system that belong to scenes with adverse operating conditions, sensors, and actuator faults. Collecting real-world data of these scenes can be expensive and sometimes not feasible. So, scenario description languages with samplers like random and grid search are available to generate synthetic data from simulators, replicating these real-world scenes. However, we point out three limitations in using these conventional samplers. First, they are passive samplers, which do not use the feedback of previous results in the sampling process. Second, the variables to be sampled may have constraints that are often not included. Third, they do not balance the tradeoff between exploration and exploitation, which we hypothesize is necessary for better search space coverage. We present a scene generation approach with two samplers called Random Neighborhood Search (RNS) and Guided Bayesian Optimization (GBO), which extend the conventional random search and Bayesian Optimization search to include the limitations. Also, to facilitate the samplers, we use a risk-based metric that evaluates how risky the scene was for the system. We demonstrate our approach using an Autonomous Vehicle example in CARLA simulation. To evaluate our samplers, we compared them against the baselines of random search, grid search, and Halton sequence search. Our samplers of RNS and GBO sampled a higher percentage of high-risk scenes of 83% and 92%, compared to 56%, 66% and 71% of the grid, random and Halton samplers, respectively.


title: Efficient Massively Parallel Join Optimization for Large Queries

abstract: Modern data analytical workloads often need to run queries over a large number of tables. An optimal query plan for such queries is crucial for being able to run these queries within acceptable time bounds. However, with queries involving many tables, finding the optimal join order becomes a bottleneck in query optimization. Due to the exponential nature of join order optimization, optimizers resort to heuristic solutions after a threshold number of tables. Our objective is two fold: (a) reduce the optimization time for generating optimal plans; and (b) improve the quality of the heuristic solution. In this paper, we propose a new massively parallel algorithm, MPDP, that can efficiently prune the large search space (via a novel plan enumeration technique) while leveraging the massive parallelism offered by modern hardware (Eg: GPUs). When evaluated on real-world benchmark queries with PostgreSQL, MPDP is at least an order of magnitude faster compared to state-of-the-art techniques for large analytical queries. As a result, we are able to increase the heuristic-fall-back limit from 12 relations to 25 relations with same time budget in PostgreSQL. Also, in order to handle queries with even larger number of tables, we augment MPDP to a well known heuristic, IDP$_2$ (iterative DP version 2) and a novel heuristic UnionDP. By systematically exploring a much larger search space, these heuristics provides query plans that are up to 7 times cheaper as compared to the state-of-the-art techniques while being faster to compute.


title: On a General Class of A-functions

abstract: Expanding upon recent work, a new class of $A$-functions is introduced that can be viewed as an appropriate generalization of the class of regular $A$-functions, the class of structured $A$-functions, and the class of perfect $A$-functions. Algebraic results are discussed and analysis is performed to deduce new results concerning rational arithmetical functions.


title: Aggressive Racecar Drifting Control Using Onboard Cameras and Inertial Measurement Unit

abstract: Complex autonomous driving, such as drifting, requires high-precision and high-frequency pose information to ensure accuracy and safety, which is notably difficult when using only onboard sensors. In this paper, we propose a drift controller with two feedback control loops: sideslip controller that stabilizes the sideslip angle by tuning the front wheel steering angle, and circle controller that maintains a stable trajectory radius and circle center by controlling the wheel rotational speed. We use an extended Kalman filter to estimate the state. A robustified KASA algorithm is further proposed to accurately estimate the parameters of the circle (i.e., the center and radius) that best fits into the current trajectory. On the premise of the uniform circular motion of the vehicle in the process of stable drift, we use angle information instead of acceleration to describe the dynamic of the vehicle. We implement our method on a 1/10 scale race car. The car drifts stably with a given center and radius, which illustrates the effectiveness of our method.


title: StrongSORT: Make DeepSORT Great Again

abstract: Recently, Multi-Object Tracking (MOT) has attracted rising attention, and accordingly, remarkable progresses have been achieved. However, the existing methods tend to use various basic models (e.g, detector and embedding model), and different training or inference tricks, etc. As a result, the construction of a good baseline for a fair comparison is essential. In this paper, a classic tracker, i.e., DeepSORT, is first revisited, and then is significantly improved from multiple perspectives such as object detection, feature embedding, and trajectory association. The proposed tracker, named StrongSORT, contributes a strong and fair baseline for the MOT community. Moreover, two lightweight and plug-and-play algorithms are proposed to address two inherent "missing" problems of MOT: missing association and missing detection. Specifically, unlike most methods, which associate short tracklets into complete trajectories at high computation complexity, we propose an appearance-free link model (AFLink) to perform global association without appearance information, and achieve a good balance between speed and accuracy. Furthermore, we propose a Gaussian-smoothed interpolation (GSI) based on Gaussian process regression to relieve the missing detection. AFLink and GSI can be easily plugged into various trackers with a negligible extra computational cost (1.7 ms and 7.1 ms per image, respectively, on MOT17). Finally, by fusing StrongSORT with AFLink and GSI, the final tracker (StrongSORT++) achieves state-of-the-art results on multiple public benchmarks, i.e., MOT17, MOT20, DanceTrack and KITTI. Codes are available at https://github.com/dyhBUPT/StrongSORT and https://github.com/open-mmlab/mmtracking.


title: Semiconductor nanowire metamaterial for broadband near-unity absorption

abstract: The realization of a semiconductor near-unity absorber in the infrared will provide new capabilities to transform applications in sensing, health, imaging, and quantum information science, especially where portability is required. Typically, commercially available portable single-photon detectors in the infrared are made from bulk semiconductors and have efficiencies well below unity. Here, we design a novel semiconductor nanowire metamaterial, and show that by carefully arranging an InGaAs nanowire array and by controlling their shape, we demonstrate near-unity absorption efficiency at room temperature. We experimentally show an average measured efficiency of 93% (simulated average efficiency of 97%) over an unprecedented wavelength range from 900 nm to 1500 nm. We further show that the near-unity absorption results from the collective response of the nanowire metamaterial, originating from both coupling into leaky resonant waveguide and transverse modes. These coupling mechanisms cause light to be absorbed directly from the top and indirectly as light scatters from one nanowire to neighbouring ones. This work leads to the possible development of a new generation of quantum detectors with unprecedented broadband near-unity absorption in the infrared, while operating near room temperature for a wider range of applications.


title: Topological band structure via twisted photons in a degenerate cavity

abstract: Synthetic dimensions based on particles' internal degrees of freedom, such as frequency, spatial modes and arrival time, have attracted significant attention. They offer ideal large-scale lattices to simulate nontrivial topological phenomena. Exploring more synthetic dimensions is one of the paths toward higher dimensional physics. In this work, we design and experimentally control the coupling among synthetic dimensions consisting of the intrinsic photonic orbital angular momentum and spin angular momentum degrees of freedom in a degenerate optical resonant cavity, which generates a periodically driven spin-orbital coupling system. We directly characterize the system's properties, including the density of states, energy band structures and topological windings, through the transmission intensity measurements. Our work demonstrates a novel mechanism for exploring the spatial modes of twisted photons as the synthetic dimension, which paves the way to design rich topological physics in a highly compact platform.


title: CTformer: Convolution-free Token2Token Dilated Vision Transformer for Low-dose CT Denoising

abstract: Low-dose computed tomography (LDCT) denoising is an important problem in CT research. Compared to the normal dose CT (NDCT), LDCT images are subjected to severe noise and artifacts. Recently in many studies, vision transformers have shown superior feature representation ability over convolutional neural networks (CNNs). However, unlike CNNs, the potential of vision transformers in LDCT denoising was little explored so far. To fill this gap, we propose a Convolution-free Token2Token Dilated Vision Transformer for low-dose CT denoising. The CTformer uses a more powerful token rearrangement to encompass local contextual information and thus avoids convolution. It also dilates and shifts feature maps to capture longer-range interaction. We interpret the CTformer by statically inspecting patterns of its internal attention maps and dynamically tracing the hierarchical attention flow with an explanatory graph. Furthermore, an overlapped inference mechanism is introduced to effectively eliminate the boundary artifacts that are common for encoder-decoder-based denoising models. Experimental results on Mayo LDCT dataset suggest that the CTformer outperforms the state-of-the-art denoising methods with a low computation overhead.


title: Inverse design of ultracompact multi-focal optical devices by diffractive neural networks

abstract: We propose an efficient inverse design approach for multifunctional optical elements based on adaptive deep diffractive neural networks (a-D$^2$NNs). Specifically, we introduce a-D$^2$NNs and design two-layer diffractive devices that can selectively focus incident radiation over two well-separated spectral bands at desired distances. We investigate focusing efficiencies at two wavelengths and achieve targeted spectral lineshapes and spatial point-spread functions (PSFs) with optimal focusing efficiency. In particular, we demonstrate control of the spectral bandwidths at separate focal positions beyond the theoretical limit of single-lens devices with the same aperture size. Finally, we demonstrate devices that produce super-oscillatory focal spots at desired wavelengths. The proposed method is compatible with current diffractive optics and doublet metasurface technology for ultracompact multispectral imaging and lensless microscopy applications.


title: PartAfford: Part-level Affordance Discovery from 3D Objects

abstract: Understanding what objects could furnish for humans-namely, learning object affordance-is the crux to bridge perception and action. In the vision community, prior work primarily focuses on learning object affordance with dense (e.g., at a per-pixel level) supervision. In stark contrast, we humans learn the object affordance without dense labels. As such, the fundamental question to devise a computational model is: What is the natural way to learn the object affordance from visual appearance and geometry with humanlike sparse supervision? In this work, we present a new task of part-level affordance discovery (PartAfford): Given only the affordance labels per object, the machine is tasked to (i) decompose 3D shapes into parts and (ii) discover how each part of the object corresponds to a certain affordance category. We propose a novel learning framework for PartAfford, which discovers part-level representations by leveraging only the affordance set supervision and geometric primitive regularization, without dense supervision. The proposed approach consists of two main components: (i) an abstraction encoder with slot attention for unsupervised clustering and abstraction, and (ii) an affordance decoder with branches for part reconstruction, affordance prediction, and cuboidal primitive regularization. To learn and evaluate PartAfford, we construct a part-level, cross-category 3D object affordance dataset, annotated with 24 affordance categories shared among >25, 000 objects. We demonstrate that our method enables both the abstraction of 3D objects and part-level affordance discovery, with generalizability to difficult and cross-category examples. Further ablations reveal the contribution of each component.


title: Anti-Malware Sandbox Games

abstract: We develop a game theoretic model of malware protection using the state-of-the-art sandbox method, to characterize and compute optimal defense strategies for anti-malware. We model the strategic interaction between developers of malware (M) and anti-malware (AM) as a two player game, where AM commits to a strategy of generating sandbox environments, and M responds by choosing to either attack or hide malicious activity based on the environment it senses. We characterize the condition for AM to protect all its machines, and identify conditions under which an optimal AM strategy can be computed efficiently. For other cases, we provide a quadratically constrained quadratic program (QCQP)-based optimization framework to compute the optimal AM strategy. In addition, we identify a natural and easy to compute strategy for AM, which as we show empirically, achieves AM utility that is close to the optimal AM utility, in equilibrium.


title: Scalable Simulation and Demonstration of Jumping Piezoelectric 2-D Soft Robots

abstract: Soft robots have drawn great interest due to their ability to take on a rich range of shapes and motions, compared to traditional rigid robots. However, the motions, and underlying statics and dynamics, pose significant challenges to forming well-generalized and robust models necessary for robot design and control. In this work, we demonstrate a five-actuator soft robot capable of complex motions and develop a scalable simulation framework that reliably predicts robot motions. The simulation framework is validated by comparing its predictions to experimental results, based on a robot constructed from piezoelectric layers bonded to a steel-foil substrate. The simulation framework exploits the physics engine PyBullet, and employs discrete rigid-link elements connected by motors to model the actuators. We perform static and AC analyses to validate a single-unit actuator cantilever setup and observe close agreement between simulation and experiments for both the cases. The analyses are extended to the five-actuator robot, where simulations accurately predict the static and AC robot motions, including shapes for applied DC voltage inputs, nearly-static "inchworm" motion, and jumping (in vertical as well as vertical and horizontal directions). These motions exhibit complex non-linear behavior, with forward robot motion reaching ~1 cm/s. Our open-source code can be found at: https://github.com/zhiwuz/sfers.


title: Pursuit-evasion differential games of players with different speeds in spaces of different dimensions

abstract: We study pursuit-evasion differential games between a faster pursuer moving in 3D space and an evader moving in a plane. We first extend the well-known Apollonius circle to 3D space, by which we construct the isochron for the considered two players. Then both cases with and without a static target are considered and the corresponding optimal strategies are derived using the concept of isochron. In order to guarantee the optimality of the proposed strategies, the value functions are given and are further proved to be the solution of Hamilton-Jacobi-Isaacs equation. Simulations with comparison between the proposed strategies and other classical strategies are carried out and the results show the optimality of the proposed strategies.


title: Magnetism and Interlayer Bonding in Pores of Bernal-Stacked Hexagonal Boron Nitride

abstract: When single-layer h-BN is subjected to a high-energy electron beam, triangular pores with nitrogen edges are formed. Because of the broken sp2 bonds, these pores are known to possess magnetic states. We report on the magnetism and electronic structure of triangular pores as a function of their size. Moreover, in the Bernal-stacked h-BN (AB-h-BN), multilayer pores with parallel edges can be created, which is not possible in the commonly fabricated multilayer AA'-h-BN. Given that these pores can be manufactured in a well-controlled fashion using an electron beam, it is important to understand the interactions of pores in neighboring layers. We find that in certain configurations, the edges of the neighboring pores remain open and retain their magnetism, and in others, they form interlayer bonds. We present a comprehensive report on these configurations for small nanopores. We find that at low temperatures, these pores have near degenerate magnetic configurations, and may be utilized in magnetoresistance and spintronics applications. In the process of forming larger multilayer nanopores, interlayer bonds can form, reducing the magnetization. Yet, unbonded parallel multilayer edges remain available at all sizes. Understanding these pores is also helpful in a multitude of applications such as DNA sequencing and quantum emission.


title: Towards Class-agnostic Tracking Using Feature Decorrelation in Point Clouds

abstract: Single object tracking in point clouds has been attracting more and more attention owing to the presence of LiDAR sensors in 3D vision. However, the existing methods based on deep neural networks focus mainly on training different models for different categories, which makes them unable to perform well in real-world applications when encountering classes unseen during the training phase. In this work, we investigate a more challenging task in the LiDAR point clouds, class-agnostic tracking, where a general model is supposed to be learned for any specified targets of both observed and unseen categories. In particular, we first investigate the class-agnostic performances of the state-of-the-art trackers via exposing the unseen categories to them during testing, finding that a key factor for class-agnostic tracking is how to constrain fused features between the template and search region to maintain generalization when the distribution is shifted from observed to unseen classes. Therefore, we propose a feature decorrelation method to address this problem, which eliminates the spurious correlations of the fused features through a set of learned weights and further makes the search region consistent among foreground points and distinctive between foreground and background points. Experiments on the KITTI and NuScenes demonstrate that the proposed method can achieve considerable improvements by benchmarking against the advanced trackers P2B and BAT, especially when tracking unseen objects.


title: Gradient-free Multi-domain Optimization for Autonomous Systems

abstract: Autonomous systems are composed of several subsystems such as mechanical, propulsion, perception, planning and control. These are traditionally designed separately which makes performance optimization of the integrated system a significant challenge. In this paper, we study the problem of using gradient-free optimization methods to jointly optimize the multiple domains of an autonomous system to find the set of optimal architectures for both hardware and software. We specifically perform multi-domain, multi-parameter optimization on an autonomous vehicle to find the best decision-making process, motion planning and control algorithms, and the physical parameters for autonomous racing. We detail the multi-domain optimization scheme, benchmark with different core components, and provide insights for generalization to new autonomous systems. In addition, this paper provides a benchmark of the performances of six different gradient-free optimizers in three different operating environments. Our approach is validated with a case study where we describe the autonomous vehicle system architecture, optimization methods, and finally, provide an argument on gradient-free optimization being a powerful choice to improve the performance of autonomous systems in an integrated manner.


title: Sparse Graph Learning with Spectrum Prior for Deep Graph Convolutional Networks

abstract: A graph convolutional network (GCN) employs a graph filtering kernel tailored for data with irregular structures. However, simply stacking more GCN layers does not improve performance; instead, the output converges to an uninformative low-dimensional subspace, where the convergence rate is characterized by the graph spectrum -- this is the known over-smoothing problem in GCN. In this paper, we propose a sparse graph learning algorithm incorporating a new spectrum prior to compute a graph topology that circumvents over-smoothing while preserving pairwise correlations inherent in data. Specifically, based on a spectral analysis of multilayer GCN output, we derive a spectrum prior for the graph Laplacian matrix $\mathbf{L}$ to robustify the model expressiveness against over-smoothing. Then, we formulate a sparse graph learning problem with the spectrum prior, solved efficiently via block coordinate descent (BCD). Moreover, we optimize the weight parameter trading off the fidelity term with the spectrum prior, based on data smoothness on the original graph learned without spectrum manipulation. The output $\mathbf{L}$ is then normalized for supervised GCN training. Experiments show that our proposal produced deeper GCNs and higher prediction accuracy for regression and classification tasks compared to competing schemes.


title: Origin of Enhanced Skin Friction at the Onset of Boundary-Layer Transition

abstract: Boundary-layer transition is accompanied by a significant increase in skin friction whose origin is rigorously explained using the stochastic Lagrangian formulation of the Navier-Stokes equations. This formulation permits the exact analysis of vorticity dynamics in individual realizations of a viscous incompressible fluid flow. The Lagrangian reconstruction formula for vorticity is here extended for the first time to Neumann boundary conditions (Lighthill source). We can thus express the wall vorticity, and therefore the wall stress, as the expectation of a stochastic Cauchy invariant in backward time, with contributions from (a) wall-vorticity flux (Lighthill source) and (b) interior vorticity that has been evolved by nonlinear advection, viscous diffusion, vortex stretching and tilting. We consider the origin of stress maxima in the transitional region, examining a sufficient number of events to represent the increased skin friction. The stochastic Cauchy analysis is applied to each event to trace the origin of the wall vorticity. We find that the Lighthill source, vortex tilting, diffusion and advection of outer vorticity make minor contributions. They are less important than spanwise stretching of near-wall spanwise vorticity, which is the dominant source of skin-friction increase during laminar-to-turbulent transition. Our analysis should assist more generally in understanding drag generation and reduction strategies and flow separation in terms of near-wall vorticity dynamics.


title: On the validity of quasilinear theory applied to the electron bump-on-tail instability

abstract: The accuracy of quasilinear theory applied to the electron bump-on-tail instability, a classic model problem, is explored with conservative high-order discontinuous Galerkin methods applied to both the quasilinear equations and to a direct simulation of the Vlasov-Poisson equations. The initial condition is chosen in the regime of beam parameters for which quasilinear theory should be applicable. Quasilinear diffusion is initially in good agreement with the direct simulation but later underestimates the turbulent momentum flux. The direct simulation corrects from quasilinear evolution by quenching the instability in a finite time and producing a robust state of oscillation. Flux enhancement above quasilinear levels occurs as the phase space eddy turnover time in the largest amplitude wavepackets becomes comparable to the transit time of resonant phase fluid through wavepacket potentials. In this regime eddies effectively turn over during wavepacket transit so that phase fluid predominantly disperses by eddy phase mixing rather than by randomly phased waves. The enhanced turbulent flux of resonant phase fluid leads in turn, through energy conservation, to an increase in non-resonant turbulent flux and thus to an enhanced heating of the main thermal body above quasilinear predictions. These findings shed light on the kinetic turbulence fluctuation spectrum and support the theory that collisionless momentum diffusion beyond the quasilinear approximation can be understood through the dynamics of phase space eddies (or clumps and granulations).


title: KMIR: A Benchmark for Evaluating Knowledge Memorization, Identification and Reasoning Abilities of Language Models

abstract: Previous works show the great potential of pre-trained language models (PLMs) for storing a large amount of factual knowledge. However, to figure out whether PLMs can be reliable knowledge sources and used as alternative knowledge bases (KBs), we need to further explore some critical features of PLMs. Firstly, knowledge memorization and identification abilities: traditional KBs can store various types of entities and relationships; do PLMs have a high knowledge capacity to store different types of knowledge? Secondly, reasoning ability: a qualified knowledge source should not only provide a collection of facts, but support a symbolic reasoner. Can PLMs derive new knowledge based on the correlations between facts? To evaluate these features of PLMs, we propose a benchmark, named Knowledge Memorization, Identification, and Reasoning test (KMIR). KMIR covers 3 types of knowledge, including general knowledge, domain-specific knowledge, and commonsense, and provides 184,348 well-designed questions. Preliminary experiments with various representative pre-training language models on KMIR reveal many interesting phenomenons: 1) The memorization ability of PLMs depends more on the number of parameters than training schemes. 2) Current PLMs are struggling to robustly remember the facts. 3) Model compression technology retains the amount of knowledge well, but hurts the identification and reasoning abilities. We hope KMIR can facilitate the design of PLMs as better knowledge sources.


title: Conjoined Charge Density Waves in the Kagome Superconductor CsV3Sb5

abstract: The intricate interplay between novel lattice geometry and spontaneous symmetry-breaking states is at the forefront of contemporary research on quantum materials. Recently, the observation of unconventional charge and pairing density waves in a kagome metal CsV3Sb5 brings out a new showcase for intertwined orders. While electronic instabilities in CsV3Sb5 are widely believed to originate from the V 3d-electrons residing on the 2-dimensional kagome sublattice, the pivotal role of Sb 5p-electrons for 3-dimensional orders is yet to be understood. Here, using resonant tender x-ray scattering and high-pressure X-ray scattering, we report a rare realization of conjoined charge density waves (CDW) in CsV3Sb5. At ambient pressure, we discover a resonant enhancement at Sb L1-edge (2s-5p) at the 2$\times$2$\times$2 CDW wavevectors. The resonance, however, is absent at the 2$\times$2 CDW wavevectors. Applying hydrostatic pressure, we find the CDW transition temperatures to separate, where the 2$\times$2$\times$2 CDW emerges 4 K above the 2$\times$2 CDW at 1GPa. Our results establish the coexistence of the 2$\times$2 CDW and the 5p-electron assisted 2$\times$2$\times$2 CDW in CsV3Sb5. The evolution of the conjoined CDWs under pressure suggests the joint importance of electronic and phononic fluctuations for the double dome superconductivity.


title: Demonstration of Parametric Instability suppression through optical feedback

abstract: We demonstrate the suppression of parametric instability using through optical actuation in an electro-optical feedback loop, stabilising the high order optical mode content in an 80 metre long Fabry-Perot cavity. The loop suppression of the high order mode is achieved by injecting a high order mode with the same frequency and opposite phase. Frequency matching is achieved by measuring the beat note signal between the fundamental and high order mode in transmission of the cavity and applying that signal to an electro-optical modulator to create the required frequency sideband. Spatial mode matching of the sideband to the high order mode is accomplished through the inherent mode overlap between the input injected beam and the high order mode of the cavity. The paper presents the theoretical analysis and experimental demonstration of parametric instability suppression, for an instability which would normally ring up with a parametric gain of approximately 2.5.


title: Analysis of tensor-product discontinous Galerkin operators for Vlasov-Poisson simulations and GPU implementation on Python

abstract: The discontinuous Galerkin (DG) finite element method is conservative, lends itself well to parallelization, and is high-order accurate due to its close affinity with the theory of quadrature and orthogonal polynomials. When applied with an orthogonal discretization (\textit{i.e.} a rectilinear grid) the DG method may be efficiently implemented on a GPU in just a few lines of high-level language such as Python. This work demonstrates such an implementation by writing the DG semi-discrete equation in a tensor-product form and then computing the products using open source GPU libraries. The results are illustrated by simulating a problem in plasma physics, namely an instability in the magnetized Vlasov-Poisson system. Further, as DG is closely related to spectral methods through its orthogonal basis it is possible to calculate a transformation to an alternative set of global eigenfunctions for purposes of analysis or to perform additional operations. This transformation is also posed as a tensor product and may be GPU-accelerated. In this work a Fourier series is computed for example (although this does not beat discrete Fourier transform), and is used to solve the Poisson part of the Vlasov-Poisson system to $\mathcal{O}(\Delta x^{n+1/2})$-accuracy.


title: Dilaton invading from infinitesimal extra dimension

abstract: We show that the Wess-Zumino action for the spontaneously broken Weyl (or conformal) symmetry, a.k.a dilaton effective action, in even $D$ dimensions can be obtained from the Kaluza-Klein dimensional reduction of the Lovelock action in $D+\epsilon$ dimensions by taking the $\epsilon \to 0$ limit, where the dilaton is identified with the metric in the extra dimension. The construction gives an explicit form of the dilaton effective action in any even dimensions.


title: On the calculation of phonons in real-space density functional theory

abstract: We present an accurate and efficient formulation for the calculation of phonons in real-space Kohn-Sham density functional theory. Specifically, employing a local exchange-correlation functional, norm-conserving pseudopotential in the Kleinman-Bylander representation, and local form for the electrostatics, we derive expressions for the dynamical matrix and associated Sternheimer equation that are particularly amenable to the real-space finite-difference method, within the framework of density functional perturbation theory. In particular, the formulation is applicable to insulating as well as metallic systems of any dimensionality, enabling the efficient and accurate treatment of semi-infinite and bulk systems alike, for both orthogonal and non-orthogonal cells. We also develop an implementation of the proposed formulation within the high-order finite-difference method. Through representative examples, we verify the accuracy of the computed phonon dispersion curves and density of states, demonstrating excellent agreement with established planewave results.


title: Maximising Wrenches for Kinematically Redundant Systems with Experiments on UVMS

abstract: This paper presents methods for finding optimal configurations and actuator forces/torques to maximise contact wrenches in a desired direction for Underwater Vehicles Manipulator Systems (UVMS). The wrench maximisation problem is formulated as a linear programming problem, and the optimal configuration is solved as a bi-level optimisation in the parameterised redundancy space. We additionally consider the cases of one or more manipulators with multiple contact forces, maximising wrench capability while tracking a trajectory, and generating large wrench impulses using dynamic motions. We look at the specific cases of maximising force to lift a heavy load, and maximising torque during a valve turning operation. Extensive experimental results are presented using an underwater robotic platform equipped with a 4DOF manipulator, and show significant increases in wrench capability compared to existing methods for UVMS.


title: LobsDICE: Offline Learning from Observation via Stationary Distribution Correction Estimation

abstract: We consider the problem of learning from observation (LfO), in which the agent aims to mimic the expert's behavior from the state-only demonstrations by experts. We additionally assume that the agent cannot interact with the environment but has access to the action-labeled transition data collected by some agents with unknown qualities. This offline setting for LfO is appealing in many real-world scenarios where the ground-truth expert actions are inaccessible and the arbitrary environment interactions are costly or risky. In this paper, we present LobsDICE, an offline LfO algorithm that learns to imitate the expert policy via optimization in the space of stationary distributions. Our algorithm solves a single convex minimization problem, which minimizes the divergence between the two state-transition distributions induced by the expert and the agent policy. Through an extensive set of offline LfO tasks, we show that LobsDICE outperforms strong baseline methods.


title: Casimir effect in kinetic theory

abstract: We study Casimir effect in equilibrium and non-equilibrium photon gas in the frame of quantum kinetic theory for $U(1)$ gauge field. We derive first the transport, constraint and gauge fixing equations for the photon number distribution from Maxwell's equations, and then calculate the energy variation and Casimir force for a finite system by considering boundary condition on the surface of the system. The Casimir force in vacuum is suppressed by the thermal motion of photons in equilibrium state, when considering two adiabatic plates. In non-equilibrium state, the photon induced Casimir force oscillates and decays with time and finally disappears.


title: Algorithm and System Co-design for Efficient Subgraph-based Graph Representation Learning

abstract: Subgraph-based graph representation learning (SGRL) has been recently proposed to deal with some fundamental challenges encountered by canonical graph neural networks (GNNs), and has demonstrated advantages in many important data science applications such as link, relation and motif prediction. However, current SGRL approaches suffer from scalability issues since they require extracting subgraphs for each training or test query. Recent solutions that scale up canonical GNNs may not apply to SGRL. Here, we propose a novel framework SUREL for scalable SGRL by co-designing the learning algorithm and its system support. SUREL adopts walk-based decomposition of subgraphs and reuses the walks to form subgraphs, which substantially reduces the redundancy of subgraph extraction and supports parallel computation. Experiments over six homogeneous, heterogeneous and higher-order graphs with millions of nodes and edges demonstrate the effectiveness and scalability of SUREL. In particular, compared to SGRL baselines, SUREL achieves 10$\times$ speed-up with comparable or even better prediction performance; while compared to canonical GNNs, SUREL achieves 50% prediction accuracy improvement.


title: Use of Transmission and Reflection Complex Time Delays to Reveal Scattering Matrix Poles and Zeros: Example of the Ring Graph

abstract: We identify the poles and zeros of the scattering matrix of a simple quantum graph by means of systematic measurement and analysis of Wigner, transmission, and reflection complex time delays. We examine the ring graph because it displays both shape and Feshbach resonances, the latter of which arises from an embedded eigenstate on the real frequency axis. Our analysis provides a unified understanding of the so-called shape, Feshbach, electromagnetically-induced transparency, and Fano resonances, on the basis of the distribution of poles and zeros of the scattering matrix in the complex frequency plane. It also provides a first-principles understanding of sharp resonant scattering features, and associated large time delay, in a variety of practical devices, including photonic microring resonators, microwave ring resonators, and mesoscopic ring-shaped conductor devices. Our analysis is the first use of reflection time difference, as well as the first comprehensive use of complex time delay, to analyze experimental scattering data.


title: Instant Loans Can Lift Subjective Well-Being: A Randomized Evaluation of Digital Credit in Nigeria

abstract: Digital loans have exploded in popularity across low and middle income countries, providing short term, high interest credit via mobile phones. This paper reports the results of a randomized evaluation of a digital loan product in Nigeria. Being randomly approved for digital credit (irrespective of credit score) substantially increases subjective well-being after an average of three months. For those who are approved, being randomly offered larger loans has an insignificant effect. Neither treatment significantly impacts other measures of welfare. We rule out large short-term impacts either positive or negative: on income and expenditures, resilience, and women's economic empowerment.


title: Pattern Based Multivariable Regression using Deep Learning (PBMR-DP)

abstract: We propose a deep learning methodology for multivariate regression that is based on pattern recognition that triggers fast learning over sensor data. We used a conversion of sensors-to-image which enables us to take advantage of Computer Vision architectures and training processes. In addition to this data preparation methodology, we explore the use of state-of-the-art architectures to generate regression outputs to predict agricultural crop continuous yield information. Finally, we compare with some of the top models reported in MLCAS2021. We found that using a straightforward training process, we were able to accomplish an MAE of 4.394, RMSE of 5.945, and R^2 of 0.861.


title: Seven non-standard models coupling quantum matter and gravity

abstract: We review seven models, which consistently couple quantum matter and (Newtonian) gravity in a non standard way. For each of them we present the underlying motivations, the main equations and, when available, a comparison with experimental data.


title: A new convective parameterization applied to Jupiter: implications for water abundance near the $24^\circ$ N region

abstract: Jupiter's atmosphere features a variety of clouds that are formed from the interplay of chemistry and atmospheric dynamics, from the deep red color of the Great Red Spot to the high altitude white ammonia clouds present in the zones (bright bands in Jupiter's atmosphere). Beneath these upper level clouds, water condensation occurs, and sporadically leads to the formation of towering convective storms, driven by the release of large amounts of latent heat. These storms result in a widespread disruption of the cloud and dynamical structure of the atmosphere at the latitude where they form, making the study of these events paramount in understanding the dynamics at depth, and the role of water in the jovian atmosphere. In this work, we use the Explicit Planetary hybrid-Isentropic Coordinate (EPIC) General Circulation Model (GCM) to study the jovian atmosphere, with a focus on moist convective storm formation from water condensation. We present the addition of a sub-grid scale moist convective module to model convective water cloud formation. We focus on the $24^\circ$ N latitude, the location of a high speed jetstream, where convective upwellings have been observed every 4-5 years. We find that the potential of convection, and vertical mass and energy flux of the atmosphere is strongly correlated with the amount of water, and we determine an upper limit of the amount of water in the the region surrounding the jet as twice the solar [O/H] ratio.


title: Estimating Treatment Effects Using Observational Data and Experimental Data with Non-overlapping Support

abstract: When estimating treatment effects, the golden standard is to conduct a randomized experiment and then contrast outcomes associated with the treatment group and the control group. However, in many cases, randomized experiments are either conducted with a much smaller scale compared to the size of the target population or accompanied with certain ethical issues and thus hard to implement. Therefore, researchers usually rely on observational data to study causal connections. The downside is that the unconfoundedness assumption, the key to validate the use of observational data is hard to verify and almost always violated. Hence, any conclusion drawn from observational data should be further analyzed with great care. Given the richness of observational data and usefulness of experimental data, researchers hope to develop credible method to combine the strength of the two. In this paper, we consider a setting where the observational data contain the outcome of interest as well as a surrogate outcome while the experimental data contain only the surrogate outcome. We propose a simple estimator to estimate the average treatment effect of interest using both the observational data and the experimental data.


title: Personalized Subsidy Rules

abstract: Subsidies are commonly used to encourage behaviors that can lead to short- or long-term benefits. Typical examples include subsidized job training programs and provisions of preventive health products, in which both behavioral responses and associated gains can exhibit heterogeneity. This study uses the marginal treatment effect (MTE) framework to study personalized assignments of subsidies based on individual characteristics. First, we derive the optimality condition for a welfare-maximizing subsidy rule by showing that the welfare can be represented as a function of the MTE. Next, we show that subsidies generally result in better welfare than directly mandating the encouraged behavior because subsidy rules implicitly target individuals through unobserved heterogeneity in the behavioral response. When there is positive selection, that is, when individuals with higher returns are more likely to select the encouraged behavior, the optimal subsidy rule achieves the first-best welfare, which is the optimal welfare if a policy-maker can observe individuals' private information. We then provide methods to (partially) identify the optimal subsidy rule when the MTE is identified and unidentified. Particularly, positive selection allows for the point identification of the optimal subsidy rule even when the MTE curve is not. As an empirical application, we study the optimal wage subsidy using the experimental data from the Jordan New Opportunities for Women pilot study.


title: Single-shot self-supervised particle tracking

abstract: Particle tracking is a fundamental task in digital microscopy. Recently, machine-learning approaches have made great strides in overcoming the limitations of more classical approaches. The training of state-of-the-art machine-learning methods almost universally relies on either vast amounts of labeled experimental data or the ability to numerically simulate realistic datasets. However, the data produced by experiments are often challenging to label and cannot be easily reproduced numerically. Here, we propose a novel deep-learning method, named LodeSTAR (Low-shot deep Symmetric Tracking And Regression), that learns to tracks objects with sub-pixel accuracy from a single unlabeled experimental image. This is made possible by exploiting the inherent roto-translational symmetries of the data. We demonstrate that LodeSTAR outperforms traditional methods in terms of accuracy. Furthermore, we analyze challenging experimental data containing densely packed cells or noisy backgrounds. We also exploit additional symmetries to extend the measurable particle properties to the particle's vertical position by propagating the signal in Fourier space and its polarizability by scaling the signal strength. Thanks to the ability to train deep-learning models with a single unlabeled image, LodeSTAR can accelerate the development of high-quality microscopic analysis pipelines for engineering, biology, and medicine.

categories: eess.IV cond-mat.soft cs.AI physics.app-ph q-bio.QM


title: RawlsGCN: Towards Rawlsian Difference Principle on Graph Convolutional Network

abstract: Graph Convolutional Network (GCN) plays pivotal roles in many real-world applications. Despite the successes of GCN deployment, GCN often exhibits performance disparity with respect to node degrees, resulting in worse predictive accuracy for low-degree nodes. We formulate the problem of mitigating the degree-related performance disparity in GCN from the perspective of the Rawlsian difference principle, which is originated from the theory of distributive justice. Mathematically, we aim to balance the utility between low-degree nodes and high-degree nodes while minimizing the task-specific loss. Specifically, we reveal the root cause of this degree-related unfairness by analyzing the gradients of weight matrices in GCN. Guided by the gradients of weight matrices, we further propose a pre-processing method RawlsGCN-Graph and an in-processing method RawlsGCN-Grad that achieves fair predictive accuracy in low-degree nodes without modification on the GCN architecture or introduction of additional parameters. Extensive experiments on real-world graphs demonstrate the effectiveness of our proposed RawlsGCN methods in significantly reducing degree-related bias while retaining comparable overall performance.


title: Two-block substitutions and morphic words

abstract: We consider in general two-block substitutions and their fixed points. We prove that some of them have a simple structure: their fixed points are morphic sequences. Others are intrinsically more complex, such as the Kolakoski sequence. We prove this for the Thue-Morse sequence in base 3/2.


title: Machine Learning Empowered Intelligent Data Center Networking: A Survey

abstract: To support the needs of ever-growing cloud-based services, the number of servers and network devices in data centers is increasing exponentially, which in turn results in high complexities and difficulties in network optimization. To address these challenges, both academia and industry turn to artificial intelligence technology to realize network intelligence. To this end, a considerable number of novel and creative machine learning-based (ML-based) research works have been put forward in recent few years. Nevertheless, there are still enormous challenges faced by the intelligent optimization of data center networks (DCNs), especially in the scenario of online real-time dynamic processing of massive heterogeneous services and traffic data. To best of our knowledge, there is a lack of systematic and original comprehensively investigations with in-depth analysis on intelligent DCN. To this end, in this paper, we comprehensively investigate the application of machine learning to data center networking, and provide a general overview and in-depth analysis of the recent works, covering flow prediction, flow classification, load balancing, resource management, routing optimization, and congestion control. In order to provide a multi-dimensional and multi-perspective comparison of various solutions, we design a quality assessment criteria called REBEL-3S to impartially measure the strengths and weaknesses of these research works. Moreover, we also present unique insights into the technology evolution of the fusion of data center network and machine learning, together with some challenges and potential future research opportunities.


title: Nonarchimedean Lyapunov exponents of polynomials

abstract: Let $K$ be an algebraically closed and complete nonarchimedean field with characteristic $0$ and let $f\in K[z]$ be a polynomial of degree $d\ge 2$. We study the Lyapunov exponent $L(f,\mu)$ of $f$ with respect to an $f$-invariant and ergodic Radon probability measure $\mu$ on the Berkovich Julia set of $f$ and the lower Lyapunov exponent $L_f^{-}(f(c))$ of $f$ at a critical value $f(c)$. Under an integrability assumption, we show $L(f,\mu)$ has a lower bound only depending on $d$ and $K$. In particular, if $f$ is tame and has no wandering nonclassical Julia points, then $L(f,\mu)$ is nonnegative; moreover, if in addition $f$ possesses a unique Julia critical point $c_0$, we show $L_f^{-}(f(c_0))$ is also nonnegative.


title: Fluctuating hydrodynamics of dilute electrolyte solutions: systematic perturbation calculation of effective transport coefficients governing large-scale dynamics

abstract: We study the transport properties of dilute electrolyte solutions on the basis of the fluctuating hydrodynamic equation, which is a set of nonlinear Langevin equations for the ion densities and flow velocity. The nonlinearity of the Langevin equations generally leads to effective kinetic coefficients for the deterministic dynamics of the average ion densities and flow velocity; the effective coefficients generally differ from the counterparts in the Langevin equations and are frequency-dependent. Using the path-integral formalism involving auxiliary fields, we perform systematic perturbation calculations of the effective kinetic coefficients for ion diffusion, shear viscosity, and electrical conductivity, which govern the dynamics on the large length scales. As novel contributions, we study the frequency dependence of the viscosity and conductivity in the one-loop approximation. Regarding the conductivity at finite frequencies, we derive the so-called electrophoretic part in addition to the relaxation part, where the latter has been obtained by Debye and Falkenhagen; it is predicted that the combination of these two parts gives rise to the frequency $\omega_{\rm max}$ proportional to the salt density, at which the real part of the conductivity exhibits a maximum. The zero-frequency limits of the conductivity and shear viscosity coincide with the classical limiting laws for dilute solutions, derived in different means by Debye, Falkenhagen, and Onsager. As for the effective kinetic coefficients for slow ion diffusions in large length scales, our straightforward calculation yields the cross kinetic coefficient between cations and anions. Further, we discuss the possibility of extending the present study to more concentrated solutions.


title: Effect of Choices of Boundary Conditions on the Numerical Efficiency of Direct Solutions of Finite Difference frequency Domain Systems with Perfectly Matched Layers

abstract: Direct solvers are a common method for solving finite difference frequency domain (FDFD) systems that arise in numerical solutions of Maxwell's equations. In a direct solver, one factorizes the system matrix. Since the system matrix is typically very sparse, the fill-in of these factors is the single most important computational consideration in terms of time complexity and memory requirements. As a result, it is of great interest to determine ways in which this fill-in can be systematically reduced. In this paper, we show that in the context of commonly used perfectly matched boundary layer methods, the choice of boundary condition behind the perfectly matched boundary layer can be exploited to reduce fill-in incurred during the factorization, leading to significant gains of up to 40 percent in the efficiency of the factorization procedure. We illustrate our findings by solving linear systems and eigenvalue problems associated with the FDFD method.


title: Towards A Device-Independent Deep Learning Approach for the Automated Segmentation of Sonographic Fetal Brain Structures: A Multi-Center and Multi-Device Validation

abstract: Quality assessment of prenatal ultrasonography is essential for the screening of fetal central nervous system (CNS) anomalies. The interpretation of fetal brain structures is highly subjective, expertise-driven, and requires years of training experience, limiting quality prenatal care for all pregnant mothers. With recent advancement in Artificial Intelligence (AI), specifically deep learning (DL), assistance in precise anatomy identification through semantic segmentation essential for the reliable assessment of growth and neurodevelopment, and detection of structural abnormalities have been proposed. However, existing works only identify certain structures (e.g., cavum septum pellucidum, lateral ventricles, cerebellum) from either of the axial views (transventricular, transcerebellar), limiting the scope for a thorough anatomical assessment as per practice guidelines necessary for the screening of CNS anomalies. Further, existing works do not analyze the generalizability of these DL algorithms across images from multiple ultrasound devices and centers, thus, limiting their real-world clinical impact. In this study, we propose a DL based segmentation framework for the automated segmentation of 10 key fetal brain structures from 2 axial planes from fetal brain USG images (2D). We developed a custom U-Net variant that uses inceptionv4 block as a feature extractor and leverages custom domain-specific data augmentation. Quantitatively, the mean (10 structures; test sets 1/2/3/4) Dice-coefficients were: 0.827, 0.802, 0.731, 0.783. Irrespective of the USG device/center, the DL segmentations were qualitatively comparable to their manual segmentations. The proposed DL system offered a promising and generalizable performance (multi-centers, multi-device) and also presents evidence in support of device-induced variation in image quality (a challenge to generalizibility) by using UMAP analysis.


title: A Machine Learning Method for Material Property Prediction: Example Polymer Compatibility

abstract: Prediction of material property is a key problem because of its significance to material design and screening. We present a brand-new and general machine learning method for material property prediction. As a representative example, polymer compatibility is chosen to demonstrate the effectiveness of our method. Specifically, we mine data from related literature to build a specific database and give a prediction based on the basic molecular structures of blending polymers and, as auxiliary, the blending composition. Our model obtains at least 75% accuracy on the dataset consisting of thousands of entries. We demonstrate that the relationship between structure and properties can be learned and simulated by machine learning method.


title: Probing the initial longitudinal density profile and electromagnetic field in ultrarelativistic heavy-ion collisions with heavy quarks

abstract: Heavy quarks are valuable probes of the electromagnetic field and the initial condition of the quark-gluon plasma (QGP) matter produced in high-energy nuclear collisions. Within an improved Langevin model that is coupled to a (3+1)-dimensional viscous hydrodynamic model, we explore the origin of the directed flow coefficient ($v_1$) of heavy mesons and their decay leptons, and its splitting ($\Delta v_{1}$) between opposite charges. We find that while the rapidity dependence of the heavy flavor $v_1$ is mainly driven by the titled energy density profile of the QGP with respect to the longitudinal direction at the RHIC energy, it is dominated by the electromagnetic field at the LHC energy. The $\Delta v_{1}$ serves as a novel probe of the spacetime evolution profile of the electromagnetic field. Our results of $D$ mesons and their decay electrons are consistent with the available data at RHIC and LHC, and our predictions on the heavy flavor decay muons can be further tested by future measurements.


title: Filter-enhanced MLP is All You Need for Sequential Recommendation

abstract: Recently, deep neural networks such as RNN, CNN and Transformer have been applied in the task of sequential recommendation, which aims to capture the dynamic preference characteristics from logged user behavior data for accurate recommendation. However, in online platforms, logged user behavior data is inevitable to contain noise, and deep recommendation models are easy to overfit on these logged data. To tackle this problem, we borrow the idea of filtering algorithms from signal processing that attenuates the noise in the frequency domain. In our empirical experiments, we find that filtering algorithms can substantially improve representative sequential recommendation models, and integrating simple filtering algorithms (eg Band-Stop Filter) with an all-MLP architecture can even outperform competitive Transformer-based models. Motivated by it, we propose \textbf{FMLP-Rec}, an all-MLP model with learnable filters for sequential recommendation task. The all-MLP architecture endows our model with lower time complexity, and the learnable filters can adaptively attenuate the noise information in the frequency domain. Extensive experiments conducted on eight real-world datasets demonstrate the superiority of our proposed method over competitive RNN, CNN, GNN and Transformer-based methods. Our code and data are publicly available at the link: \textcolor{blue}{\url{https://github.com/RUCAIBox/FMLP-Rec}}.


title: Research Needs for Realization of Zero-Carbon Power Grids with Selected Case Studies

abstract: The attainment of carbon neutrality requires a research agenda that addresses the technical and economic challenges that will be encountered as we progress toward 100% renewable electricity generation. Increasing proportions of variable renewable energy (VRE) sources (such as wind turbines and photovoltaic systems) render the supply-and-demand balance of VRE-dominated power grids difficult. The operational characteristics and effects of VRE inverters also require attention. Here, we examine the implications of the paradigm shift to carbon neutrality and summarize the associated research challenges in terms of system planning, operation, and sta-bility, and the need for energy storage integration, demand-side participation, distributed con-trol and estimation, and energy sector coupling. We also highlight the existing literature gaps, and our recent studies that can fill in the gaps, thereby facilitating the improvement of grid op-eration and estimation. The numerical results of comparative case studies are also provided on the operational stability and economics of power grids with a high level of VRE sources, assist-ing stakeholders in establishing specific roadmaps and making relevant decisions.


title: CINO: A Chinese Minority Pre-trained Language Model

abstract: Multilingual pre-trained language models have shown impressive performance on cross-lingual tasks. It greatly facilitates the applications of natural language processing on low-resource languages. However, there are still some languages that the current multilingual models do not perform well on. In this paper, we propose CINO (Chinese Minority Pre-trained Language Model), a multilingual pre-trained language model for Chinese minority languages. It covers Standard Chinese, Yue Chinese, and six other ethnic minority languages. To evaluate the cross-lingual ability of the multilingual model on ethnic minority languages, we collect documents from Wikipedia and news websites, and construct two text classification datasets, WCM (Wiki-Chinese-Minority) and CMNews (Chinese-Minority-News). We show that CINO notably outperforms the baselines on various classification tasks. The CINO model and the datasets are publicly available at http://cino.hfl-rc.com.


title: Black Hole Shadow with Soft Hair

abstract: Light bending by the strong gravity around the black hole will form the so-called black hole shadow, the shape of which can shed light on the structure of the near-horizon geometry to possibly reveal novel physics of strong gravity and black hole. In this work, we adopt both analytical and ray-tracing methods to study the black hole shadow in the presence of the infrared structure of gravity theory, which manifests the asymptotic symmetries of spacetime as the supertranslation soft hairs of the black hole. Though the black hole metrics with and without the soft hair are related by large gauge transformations, the near horizon geometries relevant for the shape of the shadow are quite different. Moreover, the Hamiltonian for the geodesic seems intrinsically different, i.e., the loss of separability due to the breaking of spherical symmetry by soft hair. By applying ray-tracing computations, we find that the soft hair, although not affecting the shape of the shadow, may change the average size and position of the shadow. Images resulting from soft hair black holes with surrounding accretion flows are also discussed.


title: ConvNeXt-backbone HoVerNet for nuclei segmentation and classification

abstract: This manuscript gives a brief description of the algorithm used to participate in CoNIC Challenge 2022. After the baseline was made available, we follow the method in it and replace the ResNet baseline with ConvNeXt one. Moreover, we propose to first convert RGB space to Haematoxylin-Eosin-DAB(HED) space, then use Haematoxylin composition of origin image to smooth semantic one hot label. Afterwards, nuclei distribution of train and valid set are explored to select the best fold split for training model for final test phase submission. Results on validation set shows that even with channel of each stage smaller in number, HoVerNet with ConvNeXt-tiny backbone still improves the mPQ+ by 0.04 and multi r2 by 0.0144


title: On a Fractional Nirenberg problem involving the square root of the Laplacian on $\mathbb{S}^{3}$

abstract: In this paper, we are devoted to establishing the compactness and existence results of the solutions to the fractional Nirenberg problem for $n=3,$ $\sigma=1/2,$ when the prescribing $\sigma$-curvature function satisfies the $(n-2\sigma)$-flatness condition near its critical points. The compactness results are new and optimal. In addition, we obtain a degree-counting formula of all solutions. From our results, we can know where blow up occur. Moreover, for any finite distinct points, the sequence of solutions that blow up precisely at these points can be constructed. We extend the results of Li in \cite[CPAM, 1996]{LYY} from the local problem to nonlocal cases.


title: Name Your Style: An Arbitrary Artist-aware Image Style Transfer

abstract: Image style transfer has attracted widespread attention in the past few years. Despite its remarkable results, it requires additional style images available as references, making it less flexible and inconvenient. Using text is the most natural way to describe the style. More importantly, text can describe implicit abstract styles, like styles of specific artists or art movements. In this paper, we propose a text-driven image style transfer (TxST) that leverages advanced image-text encoders to control arbitrary style transfer. We introduce a contrastive training strategy to effectively extract style descriptions from the image-text model (i.e., CLIP), which aligns stylization with the text description. To this end, we also propose a novel and efficient attention module that explores cross-attentions to fuse style and content features. Finally, we achieve an arbitrary artist-aware image style transfer to learn and transfer specific artistic characters such as Picasso, oil painting, or a rough sketch. Extensive experiments demonstrate that our approach outperforms the state-of-the-art methods on both image and textual styles. Moreover, it can mimic the styles of one or many artists to achieve attractive results, thus highlighting a promising direction in image style transfer.


title: The preliminary statistical analysis of LAMOST DR8 low resolution AFGK stars

abstract: We download the LAMOST DR8 low resolution catalog 6,478,063 AFGK tpye stars and plot the figures of effective temperature, gravitational acceleration, and metal abundance. Some small and medium mass stars are evolved from pre-main sequence or main sequence stage to planetary nebula stage or white dwarf stage by the stellar evolution code \texttt{MESA}. We analyze the observed statistical data and model calculation results, and then obtain some basic conclusions preliminarily. Most red giant and asymptotic giant stars with log$g$ less than 0.85 have poor metal abundance. Most hot A type main-sequence stars are metal rich stars with log$g$ from 3.5 to 4.5. The conclusions are reasonable within a certain error range. The theory of a gap area in the H-R diagram for stellar evolutions of medium mass stars is reflected in the statistical figures. The central core hydrogen burning stage and the central core helium burning stage correspond to the peak structures in the gravitational acceleration statistical figures respectively. The metal abundances among A, F, G, and K type stars have a wide distribution. We can not simply replace the metal abundances of these stars with the metal abundance of the Sun when doing a fine research work.


title: Towards Machine Learning for Placement and Routing in Chip Design: a Methodological Overview

abstract: Placement and routing are two indispensable and challenging (NP-hard) tasks in modern chip design flows. Compared with traditional solvers using heuristics or expert-well-designed algorithms, machine learning has shown promising prospects by its data-driven nature, which can be of less reliance on knowledge and priors, and potentially more scalable by its advanced computational paradigms (e.g. deep networks with GPU acceleration). This survey starts with the introduction of basics of placement and routing, with a brief description on classic learning-free solvers. Then we present detailed review on recent advance in machine learning for placement and routing. Finally we discuss the challenges and opportunities for future research.


title: A Holistic Review on Advanced Bi-directional EV Charging Control Algorithms

abstract: The rapid growth of electric vehicles (EVs) has promised a next-generation transportation system with reduced carbon emission. The fast development of EVs and charging facilities is driving the evolution of Internet of Vehicles (IoV) to Internet of Electric Vehicles (IoEV). IoEV benefits from both smart grid and Internet of Things (IoT) technologies which provide advanced bi-directional charging services and real-time data processing capability, respectively. The major design challenges of the IoEV charging control lie in the randomness of charging events and the mobility of EVs. In this article, we present a holistic review on advanced bi-directional EV charging control algorithms. For Grid-to-Vehicle (G2V), we introduce the charging control problem in two scenarios: 1) Operation of a single charging station and 2) Operation of multiple charging stations in coupled transportation and power networks. For Vehicle-to-Grid (V2G), we discuss how EVs can perform energy trading in the electricity market and provide ancillary services to the power grid. Besides, a case study is provided to illustrate the economic benefit of the joint optimization of routing and charging scheduling of multiple EVs in the IoEV. Last but not the least, we will highlight some open problems and future research directions of charging scheduling problems for IoEVs.


title: Learning Parameters for a Generalized Vidale-Wolfe Response Model with Flexible Ad Elasticity and Word-of-Mouth

abstract: In this research, we investigate a generalized form of Vidale-Wolfe (GVW) model. One key element of our modeling work is that the GVW model contains two useful indexes representing advertiser's elasticity and the word-of-mouth (WoM) effect, respectively. Moreover, we discuss some desirable properties of the GVW model, and present a deep neural network (DNN)-based estimation method to learn its parameters. Furthermore, based on three realworld datasets, we conduct computational experiments to validate the GVW model and identified properties. In addition, we also discuss potential advantages of the GVW model over econometric models. The research outcome shows that both the ad elasticity index and the WoM index have significant influences on advertising responses, and the GVW model has potential advantages over econometric models of advertising, in terms of several interesting phenomena drawn from practical advertising situations. The GVW model and its deep learning-based estimation method provide a basis to support big data-driven advertising analytics and decision makings; in the meanwhile, identified properties and experimental findings of this research illuminate critical managerial insights for advertisers in various advertising forms.


title: Effect of Polarized Colliding Beam on Higgs Boson production at the Lepton Collider

abstract: Different production processes involving the Higgs boson, such as annihilation and W/Z boson fusion, will be observed in the International Linear Collider (ILC). The ILC operates at a center-of-mass (CM) energy of $\sqrt{s}$ = 200-1000 GeV. The study reveals that the production cross-section can either be enhanced or reduced depending on the CM energy and the specific combination used, which has implications for selecting appropriate production processes. Additionally, this investigation highlights that by polarizing beams, the number of measurable observables increases. These observables, such as left$~$right asymmetry, detailed effective polarization, and adequate effective luminosity, are crucial to ascertain contemporary physical parameters in physics models absurdly the Standard Model (SM).


title: On D-modules of categories II

abstract: In our paper "On D-module of categories I", we provide two different methods of constructing D-module structures on the complex computing periodic cyclic homology associated to a family of stable infinity categories. One is based on a canonical extension of factorization homology. Another method uses the pair of Hochschild cohomology and Hochschild homology, Kodaira-Spencer map for a family of stable infinity categories, Koszul dualities,and the relation between dg Lie algebras and pointed formal stacks. In this paper, we prove that two resulting structures coindice.


title: On the Application of Quasi-Degradation to Network NOMA in Downlink CoMP Systems

abstract: The application of network non-orthogonal multiple access (N-NOMA) technique to coordinated multi-point (CoMP) systems has attracted significant attention due to its superior capability to improve connectivity and maintain reliable transmission for CoMP users simultaneously. Based on the concept of quasi-degraded channel for N-NOMA, this paper studies the precoding design for downlink N-NOMA scenarios with two base stations (BSs) equipped with multiple antennas. In specific, under quasi-degraded channels, simple linear precoding based N-NOMA can achieve the same minimal total transmission power as theoretically optimal but complicated dirty paper coding (DPC) scheme, when the users' target rates and minimal transmission power of each BS are given. In this paper, the channel quasi-degradation (QD) condition is first rigorously derived for the scenario with single CoMP user and two NOMA users. The closed-form optimal precoders for N-NOMA under quasi-degraded channels are also provided. Then, based on QD condition, a novel hybrid N-NOMA (H-N-NOMA) scheme is proposed, which is a mixture of N-NOMA and conventional zero-forcing beamforming (ZFBF) scheme. Further, for the scenarios with more users, a low-complexity QD based user pairing (QDUP) algorithm is proposed. Numerical results are presented to reveal the impact factors of QD channels, and also demonstrate the superior performance of the proposed H-N-NOMA/QDUP scheme. It is shown that the proposed H-N-NOMA/QDUP scheme can effectively exploit the benefit of multi user diversity.


title: Compact hidden charm pentaquark states and QCD isomers

abstract: We make an exhaustive investigation on the pentaquark states $qqqc\bar{c}$ ($q=u, d$ and $s$) and discuss the effect of color structures in a multiquark color flux-tube model. We exhibit a novel picture of the structure and properties of the states $P_c$ and $P_{cs}$ observed by the LHCb Collaboration. We can describe the states as the compact pentaquark states in the model. The spin-parity of the group of $P_c(4312)^+$ and $P_c(4337)^+$ is $\frac{1}{2}^-$ while that of the group of $P_c(4380)^+$, $P_c(4440)^+$ and $P_c(4457)^+$ is $\frac{3}{2}^-$. Their structures are pentagon, diquark, pentagon, diquark, and octet, respectively. The members in each group can be analogically called QCD isomers because of their the same spin-parity and quark content but different color structures. The singlet $P_{cs}(4459)^0$ has pentagon structure and spin-parity of $\frac{1}{2}^-$. In addition, we also predict the $P_{cs}$, $P_{c ss}$ and $P_{csss}$ families in the model. The five-body confinement potential based on the color flux-tube picture, which is a collective degree of freedom and induces QCD isomer phenomenon, plays an important role in the formation of the compact states.


title: Binding of anisotropic curvature-inducing proteins onto membrane tubes

abstract: Bin/Amphiphysin/Rvs superfamily proteins and other curvature-inducing proteins have anisotropic shapes and anisotropically bend biomembrane. Here, we report how the anisotropic proteins bind the membrane tube and are orientationally ordered using mean-field theory including an orientation-dependent excluded volume. The proteins exhibit a second-order or first-order nematic transition with increasing protein density depending on the radius of the membrane tube. The tube curvatures for the maximum protein binding and orientational order are different and varied by the protein density and rigidity. As the external force along the tube axis increases, a first-order transition from a large tube radius with low protein density to a small radius with high density occurs once, and subsequently, the protein orientation tilts to the tube-axis direction. When an isotropic bending energy is used for the proteins with an elliptic shape, the force-dependence curves become symmetric and the first-order transition occurs twice. This theory quantitatively reproduces the results of meshless membrane simulation for short proteins, whereas deviations are seen for long proteins owing to the formation of protein clusters.


title: Optimizing Information Freshness in RIS-assisted NOMA-based IoT Networks

abstract: This paper investigates the benefits of integrating reconfigurable intelligent surface (RIS) on minimizing the average sum age of information (AoI) in uplink non-orthogonal multiple access-based Internet-of-Things (IoT) networks. In this setup, an optimization problem is formulated to optimize the RIS configuration, the transmit power per IoT device and the clustering policy of IoT devices. The formulated problem is a mixed-integer non-convex one, and in order to solve it we obtain first the RIS configuration by adopting a semi-definite relaxation (SDR) approach. Afterwards, the joint power allocation and user-clustering problem is solved using the concept of bi-level optimization and is decomposed into an outer user clustering problem and an inner power allocation problem. Optimal closed-form expressions are derived for the inner problem and the Hungarian method is employed to solve the outer one. Numerical results demonstrate the performance superiority of our approach.


title: Primitively universal quaternary quadratic forms

abstract: A (positive definite and integral) quadratic form $f$ is said to be $\textit{universal}$ if it represents all positive integers, and is said to be $\textit{primitively universal}$ if it represents all positive integers primitively. We also say $f$ is $\textit{primitively almost universal}$ if it represents almost all positive integers primitively. Conway and Schneeberger proved (see [1]) that there are exactly $204$ equivalence classes of universal quaternary quadratic forms. Recently, Earnest and Gunawardana proved in [4] that among $204$ equivalence classes of universal quaternary quadratic forms, there are exactly $152$ equivalence classes of primitively almost universal quaternary quadratic forms. In this article, we prove that there are exactly $107$ equivalence classes of primitively universal quaternary quadratic forms. We also determine the set of all positive integers that are not primitively represented by each of the remaining $152-107=45$ equivalence classes of primitively almost universal quaternary quadratic forms.


title: Introduction to phase transmission fibre-optic sensing of seismic waves

abstract: This manuscript is concerned with phase changes of signals transmitted through deforming optical fibres. As a first result, it establishes an exact relation between observable phase changes and the deformation tensor along the fibre. This relation is non-linear, and it includes effects related to both local changes in fibre length and deformation-induced changes of the local speed of light or refractive index. In seismic applications, where the norm of the earthquake-induced deformation tensor is orders of magnitude smaller than 1, a useful first-order relation can be derived. It simply connects phase changes to an integral over in-line strain along the fibre times the local refractive index. Under the assumption that spatial variations of the refractive index are fast compared to the seismic wavelength, this permits a direct synthesis of phase change measurements from distributed strain measurements, for instance, from Distributed Acoustic Sensing (DAS). A more detailed analysis of the first-order relation reveals that a perfectly straight fibre would produce zero phase change measurements, unless deformation was sufficiently widespread to affect the starting and end points of the fibre. If this condition is not met, non-zero measurements can only result from curvature of the fibre or from a heterogeneous distribution of the refractive index. Segments of the fibre that are strongly curved generally make larger contributions to the observed phase change.


title: On an anisotropic double phase problem with singular and sign changing nonlinearity

abstract: This article consists of study of anisotropic double phase problems with singular term and sign changing subcritical as well as critical nonlinearity. Seeking the help of well known Nehari manifold technique, we establish existence of at least two opposite sign energy solutions in the subcritical case and one negative energy solution in the critical case. The results in the critical case is even new in the classical $p$-Laplacian case.


title: KL Divergence Estimation with Multi-group Attribution

abstract: Estimating the Kullback-Leibler (KL) divergence between two distributions given samples from them is well-studied in machine learning and information theory. Motivated by considerations of multi-group fairness, we seek KL divergence estimates that accurately reflect the contributions of sub-populations to the overall divergence. We model the sub-populations coming from a rich (possibly infinite) family $\mathcal{C}$ of overlapping subsets of the domain. We propose the notion of multi-group attribution for $\mathcal{C}$, which requires that the estimated divergence conditioned on every sub-population in $\mathcal{C}$ satisfies some natural accuracy and fairness desiderata, such as ensuring that sub-populations where the model predicts significant divergence do diverge significantly in the two distributions. Our main technical contribution is to show that multi-group attribution can be derived from the recently introduced notion of multi-calibration for importance weights [HKRR18, GRSW21]. We provide experimental evidence to support our theoretical results, and show that multi-group attribution provides better KL divergence estimates when conditioned on sub-populations than other popular algorithms.


title: Point Set Self-Embedding

abstract: This work presents an innovative method for point set self-embedding, that encodes the structural information of a dense point set into its sparser version in a visual but imperceptible form. The self-embedded point set can function as the ordinary downsampled one and be visualized efficiently on mobile devices. Particularly, we can leverage the self-embedded information to fully restore the original point set for detailed analysis on remote servers. This task is challenging since both the self-embedded point set and the restored point set should resemble the original one. To achieve a learnable self-embedding scheme, we design a novel framework with two jointly-trained networks: one to encode the input point set into its self-embedded sparse point set and the other to leverage the embedded information for inverting the original point set back. Further, we develop a pair of up-shuffle and down-shuffle units in the two networks, and formulate loss terms to encourage the shape similarity and point distribution in the results. Extensive qualitative and quantitative results demonstrate the effectiveness of our method on both synthetic and real-scanned datasets.


title: Local central limit theorem for gradient field models

abstract: We consider the gradient field model in $\left[ -N,N\right] ^{2}\cap \mathbb{Z}^{2}$ with a uniformly convex interaction potential. Naddaf-Spencer \cite{NS} and Miller \cite{Mi} proved that the macroscopic averages of linear statistics of the field converge to a continuum Gaussian free field. In this paper we prove the distribution of $\phi(0)/\sqrt{\log N}$ converges uniformly to a Gaussian density, with a Berry-Esseen type bound. This implies the distribution of $\phi(0)$ is sufficiently `Gaussian like' between $[-\sqrt {\log N}, \sqrt {\log N}]$.


title: Functional sufficient dimension reduction through distance covariance

abstract: Our research proposes a novel method for reducing the dimensionality of functional data, specifically for the case where the response is a scalar and the predictor is a random function. Our method utilizes distance covariance, and has several advantages over existing methods. Unlike current techniques which require restrictive assumptions such as linear conditional mean and constant covariance, our method has mild requirements on the predictor. Additionally, our method does not involve the use of the unbounded inverse of the covariance operator. The link function between the response and predictor can be arbitrary, and our proposed method maintains the advantage of being model-free, without the need to estimate the link function. Furthermore, our method is naturally suited for sparse longitudinal data. We utilize functional principal component analysis with truncation as a regularization mechanism in the development of our method. We provide justification for the validity of our proposed method, and establish statistical consistency of the estimator under certain regularization conditions. To demonstrate the effectiveness of our proposed method, we conduct simulation studies and real data analysis. The results show improved performance compared to existing methods.


title: Femtosecond laser-shockwave induced densification in fused silica

abstract: Tightly focused femtosecond laser-beam in the non-ablative regime can induce a shock-wave enough to reach locally pressures in the giga-Pascal range or more. In a single beam configuration, the location of the highest-pressure zone is nested within the laser-focus zone, making it difficult to differentiate the effect of the shock-wave pressure from photo-induced and plasma relaxation effect. To circumvent this difficulty, we consider two spatially separated focused beams that individually act as quasi-simultaneous pressure-wave emitters. The zone where both shock-waves interfere constructively forms a region of extreme pressure range, physically separated from the regions under direct laser exposure. Here, we present evidences of pressured-induced densification in fused silica in between the foci of the two beams, which can be exclusively attributed to the superposition of the pressure waves emitted by each focused laser-beam. Specifically, we show how the beams gap and pulses time-delay affect the structural properties of fused silica using Raman characterization, beam deflection technique, and selective etching techniques. The method is generic and can be implemented in a variety of transparent substrates for high-pressure physics studies and, unlike classical methods, such as the use of diamond anvils, offers a means to create arbitrary-shaped laser-induced high-pressure impacted zones by scanning the two beams across the specimen volume


title: 'Tis but Thy Name: Semantic Question Answering Evaluation with 11M Names for 1M Entities

abstract: Classic lexical-matching-based QA metrics are slowly being phased out because they punish succinct or informative outputs just because those answers were not provided as ground truth. Recently proposed neural metrics can evaluate semantic similarity but were trained on small textual similarity datasets grafted from foreign domains. We introduce the Wiki Entity Similarity (WES) dataset, an 11M example, domain targeted, semantic entity similarity dataset that is generated from link texts in Wikipedia. WES is tailored to QA evaluation: the examples are entities and phrases and grouped into semantic clusters to simulate multiple ground-truth labels. Human annotators consistently agree with WES labels, and a basic cross encoder metric is better than four classic metrics at predicting human judgments of correctness.


title: Suppression of ferromagnetism and influence of disorder in silicon-substituted CeRh6Ge4

abstract: We report a study of isoelectronic chemical substitution in the recently discovered quantum critical ferromagnet CeRh$_6$Ge$_4$. Upon silicon-doping, the ferromagnetic ordering temperature of CeRh$_6$(Ge$_{1-x}$Si$_x$)$_4$ is continuously suppressed, and no transition is observed beyond $x_c$$\approx$0.125. Non-Fermi liquid behavior with $C/T \propto$log($T^*/T$) is observed close to $x_c$, indicating the existence of strong quantum fluctuations, while the $T$-linear behavior observed upon pressurizing the parent compound is absent in the resistivity, which appears to be a consequence of the disorder induced by silicon doping. Our findings provide evidence for the role played by disorder on the unusual ferromagnetic quantum criticality in CeRh$_6$Ge$_4$, and provides further evidence for understanding the origin of this behavior.


title: A nanodiamonds-engineered optical-fiber plasmonic interface for sensitivity-enhanced biosensing

abstract: Benefitting from the excellent characteristics such as low cytotoxicity, functionalization versatility, and tunable fluorescence, nanodiamonds (NDs) have shown enormous application potentials in the biomedical field. Herein, we proposed, for the first time to our best knowledge, to integrate NDs on a plasmonic interface constructed on a side-polished fiber using drop-casting method. The added NDs engineers the plasmonic interface towards improving the sensing field, thus enhancing the sensitivity, which, moreover, is significantly dependent on the number of drop-casting cycles (DCs) and the used concentration of NDs dispersion solution. Experimental results suggest that properly increasing the NDs dispersion concentration is beneficial to obtain a higher sensitivity while using a fewer number of DCs, but the excessive concentration extremely deteriorates the resonance dip. Experimentally, using the optimal 0.2 mg/mL concentration and 3 DCs, we achieve the highest RI sensitivity of 3582 nm/RIU, which shows an enhancement of 73.8% compared to the case without NDs modification. The sensitivity enhancement in biosensing is also proved by employing bovine serum albumin as a demo. The behind mechanism is explored via characterizations and simulations. This work opens up a new application form for NDs, i.e. integrating NDs with a plasmonic interface towards high-performance biosensing.


title: Fractional integration with singularity on the light-cone

abstract: We study a family of convolution operators whose symbols and kernels have singularity on the light-cone in $\mathbb{R}^{n+1}$. First, we prove a desired ${\bf L}^p\to {\bf L}^q$ norm inequality which has been left open. Moreover, we obtain certain sharp regularity results for the cone multiplier problem of negative order.


title: Markov Chain Monte Carlo-Based Machine Unlearning: Unlearning What Needs to be Forgotten

abstract: As the use of machine learning (ML) models is becoming increasingly popular in many real-world applications, there are practical challenges that need to be addressed for model maintenance. One such challenge is to 'undo' the effect of a specific subset of dataset used for training a model. This specific subset may contain malicious or adversarial data injected by an attacker, which affects the model performance. Another reason may be the need for a service provider to remove data pertaining to a specific user to respect the user's privacy. In both cases, the problem is to 'unlearn' a specific subset of the training data from a trained model without incurring the costly procedure of retraining the whole model from scratch. Towards this goal, this paper presents a Markov chain Monte Carlo-based machine unlearning (MCU) algorithm. MCU helps to effectively and efficiently unlearn a trained model from subsets of training dataset. Furthermore, we show that with MCU, we are able to explain the effect of a subset of a training dataset on the model prediction. Thus, MCU is useful for examining subsets of data to identify the adversarial data to be removed. Similarly, MCU can be used to erase the lineage of a user's personal data from trained ML models, thus upholding a user's "right to be forgotten". We empirically evaluate the performance of our proposed MCU algorithm on real-world phishing and diabetes datasets. Results show that MCU can achieve a desirable performance by efficiently removing the effect of a subset of training dataset and outperform an existing algorithm that utilizes the remaining dataset.


title: Hilbert Boundary Value Problems for Hyper Monogenic Functions on The Hyperplane

abstract: This paper systematically studies Hilbert boundary value problems for hyper monogenic functions on the hyperplane for the solutions being of any integer orders at the infinity, where the negative order cases are new even when restricted to the complex plane context. The explicit solution formulas are given and the solvability conditions are specified. The results are proved through using the Clifford symmetric extension method to reduce Hilbert boundary value problems to Riemann boundary value problems.


title: Rethinking and Refining the Distinct Metric

abstract: Distinct-$n$ score\cite{Li2016} is a widely used automatic metric for evaluating diversity in language generation tasks. However, we observed that the original approach for calculating distinct scores has evident biases that tend to assign higher penalties to longer sequences. We refine the calculation of distinct scores by scaling the number of distinct tokens based on their expectations. We provide both empirical and theoretical evidence to show that our method effectively removes the biases existing in the original distinct score. Our experiments show that our proposed metric, \textit{Expectation-Adjusted Distinct (EAD)}, correlates better with human judgment in evaluating response diversity. To foster future research, we provide an example implementation at \url{https://github.com/lsy641/Expectation-Adjusted-Distinct}.


title: Using Multi-scale SwinTransformer-HTC with Data augmentation in CoNIC Challenge

abstract: Colorectal cancer is one of the most common cancers worldwide, so early pathological examination is very important. However, it is time-consuming and labor-intensive to identify the number and type of cells on H&E images in clinical. Therefore, automatic segmentation and classification task and counting the cellular composition of H&E images from pathological sections is proposed by CoNIC Challenge 2022. We proposed a multi-scale Swin transformer with HTC for this challenge, and also applied the known normalization methods to generate more augmentation data. Finally, our strategy showed that the multi-scale played a crucial role to identify different scale features and the augmentation arose the recognition of model.


title: Unsupervised Point Cloud Representation Learning with Deep Neural Networks: A Survey

abstract: Point cloud data have been widely explored due to its superior accuracy and robustness under various adverse situations. Meanwhile, deep neural networks (DNNs) have achieved very impressive success in various applications such as surveillance and autonomous driving. The convergence of point cloud and DNNs has led to many deep point cloud models, largely trained under the supervision of large-scale and densely-labelled point cloud data. Unsupervised point cloud representation learning, which aims to learn general and useful point cloud representations from unlabelled point cloud data, has recently attracted increasing attention due to the constraint in large-scale point cloud labelling. This paper provides a comprehensive review of unsupervised point cloud representation learning using DNNs. It first describes the motivation, general pipelines as well as terminologies of the recent studies. Relevant background including widely adopted point cloud datasets and DNN architectures is then briefly presented. This is followed by an extensive discussion of existing unsupervised point cloud representation learning methods according to their technical approaches. We also quantitatively benchmark and discuss the reviewed methods over multiple widely adopted point cloud datasets. Finally, we share our humble opinion about several challenges and problems that could be pursued in future research in unsupervised point cloud representation learning. A project associated with this survey has been built at https://github.com/xiaoaoran/3d_url_survey.


title: LCP-dropout: Compression-based Multiple Subword Segmentation for Neural Machine Translation

abstract: In this study, we propose a simple and effective preprocessing method for subword segmentation based on a data compression algorithm. Compression-based subword segmentation has recently attracted significant attention as a preprocessing method for training data in Neural Machine Translation. Among them, BPE/BPE-dropout is one of the fastest and most effective method compared to conventional approaches. However, compression-based approach has a drawback in that generating multiple segmentations is difficult due to the determinism. To overcome this difficulty, we focus on a probabilistic string algorithm, called locally-consistent parsing (LCP), that has been applied to achieve optimum compression. Employing the probabilistic mechanism of LCP, we propose LCP-dropout for multiple subword segmentation that improves BPE/BPE-dropout, and show that it outperforms various baselines in learning from especially small training data.


title: Minimal Absent Words on Run-Length Encoded Strings

abstract: A string $w$ is called a minimal absent word (MAW) for another string $T$ if $w$ does not occur (as a substring) in $T$ and any proper substring of $w$ occurs in $T$. State-of-the-art data structures for reporting the set $\mathsf{MAW}(T)$ of MAWs from a given string $T$ of length $n$ require $O(n)$ space, can be built in $O(n)$ time, and can report all MAWs in $O(|\mathsf{MAW}(T)|)$ time upon a query. This paper initiates the problem of computing MAWs from a compressed representation of a string. In particular, we focus on the most basic compressed representation of a string, run-length encoding (RLE), which represents each maximal run of the same characters $a$ by $a^p$ where $p$ is the length of the run. Let $m$ be the RLE-size of string $T$. After categorizing the MAWs into five disjoint sets $\mathcal{M}_1$, $\mathcal{M}_2$, $\mathcal{M}_3$, $\mathcal{M}_4$, $\mathcal{M}_5$ using RLE, we present matching upper and lower bounds for the number of MAWs in $\mathcal{M}_i$ for $i = 1,2,4,5$ in terms of RLE-size $m$, except for $\mathcal{M}_3$ whose size is unbounded by $m$. We then present a compact $O(m)$-space data structure that can report all MAWs in optimal $O(|\mathsf{MAW}(T)|)$ time.