title: Hybrid Simulator for Space Docking and Robotic Proximity Operations

abstract: In this work, we present a hybrid simulator for space docking and robotic proximity operations methodology. This methodology also allows for the emulation of a target robot operating in a complex environment by using an actual robot. The emulation scheme aims to replicate the dynamic behavior of the target robot interacting with the environment, without dealing with a complex calculation of the contact dynamics. This method forms a basis for the task verification of a flexible space robot. The actual emulating robot is structurally rigid, while the target robot can represent any class of robots, e.g., flexible, redundant, or space robots. Although the emulating robot is not dynamically equivalent to the target robot, the dynamical similarity can be achieved by using a control law developed herein. The effect of disturbances and actuator dynamics on the fidelity and the contact stability of the robot emulation is thoroughly analyzed.


title: An associative memory model with very high memory rate: Image storage by sequential addition learning

abstract: In this paper, we present a neural network system related to about memory and recall that consists of one neuron group (the "cue ball") and a one-layer neural net (the "recall net"). This system realizes the bidirectional memorization learning between one cue neuron in the cue ball and the neurons in the recall net. It can memorize many patterns and recall these patterns or those that are similar at any time. Furthermore, the patterns are recalled at most the same time. This model's recall situation seems to resemble human recall of a variety of similar things almost simultaneously when one thing is recalled. It is also possible for additional learning to occur in the system without affecting the patterns memorized in advance. Moreover, the memory rate (the number of memorized patterns / the total number of neurons) is close to 100%; this system's rate is 0.987. Finally, pattern data constraints become an important aspect of this system.


title: GRANITE: A Graph Neural Network Model for Basic Block Throughput Estimation

abstract: Analytical hardware performance models yield swift estimation of desired hardware performance metrics. However, developing these analytical models for modern processors with sophisticated microarchitectures is an extremely laborious task and requires a firm understanding of target microarchitecture's internal structure. In this paper, we introduce GRANITE, a new machine learning model that estimates the throughput of basic blocks across different microarchitectures. GRANITE uses a graph representation of basic blocks that captures both structural and data dependencies between instructions. This representation is processed using a graph neural network that takes advantage of the relational information captured in the graph and learns a rich neural representation of the basic block that allows more precise throughput estimation. Our results establish a new state-of-the-art for basic block performance estimation with an average test error of 6.9% across a wide range of basic blocks and microarchitectures for the x86-64 target. Compared to recent work, this reduced the error by 1.7% while improving training and inference throughput by approximately 3.0x. In addition, we propose the use of multi-task learning with independent multi-layer feed forward decoder networks. Our results show that this technique further improves precision of all learned models while significantly reducing per-microarchitecture training costs. We perform an extensive set of ablation studies and comparisons with prior work, concluding a set of methods to achieve high accuracy for basic block performance estimation.


title: ViewFool: Evaluating the Robustness of Visual Recognition to Adversarial Viewpoints

abstract: Recent studies have demonstrated that visual recognition models lack robustness to distribution shift. However, current work mainly considers model robustness to 2D image transformations, leaving viewpoint changes in the 3D world less explored. In general, viewpoint changes are prevalent in various real-world applications (e.g., autonomous driving), making it imperative to evaluate viewpoint robustness. In this paper, we propose a novel method called ViewFool to find adversarial viewpoints that mislead visual recognition models. By encoding real-world objects as neural radiance fields (NeRF), ViewFool characterizes a distribution of diverse adversarial viewpoints under an entropic regularizer, which helps to handle the fluctuations of the real camera pose and mitigate the reality gap between the real objects and their neural representations. Experiments validate that the common image classifiers are extremely vulnerable to the generated adversarial viewpoints, which also exhibit high cross-model transferability. Based on ViewFool, we introduce ImageNet-V, a new out-of-distribution dataset for benchmarking viewpoint robustness of image classifiers. Evaluation results on 40 classifiers with diverse architectures, objective functions, and data augmentations reveal a significant drop in model performance when tested on ImageNet-V, which provides a possibility to leverage ViewFool as an effective data augmentation strategy to improve viewpoint robustness.


title: Determination of Complex Refractive Index using Maximum Deviation Angle through Prism

abstract: Light-absorbing materials are widely used, and their optical properties are an important factor. Snell's law does not hold in materials that partially absorb light. Hence, the optical path in refraction is calculated from Maxwell's law. We used it to obtain the deviation angle when a light passes through a prism made of light absorbing material. As a result, the deviation angle has a local maximum point. The deviation angle near the local maximum is sensitive to the real and imaginary parts of the refractive index. The local maximum deviation angle and its incident angle are used to determine the complex index of refraction. This measurement has the same advantages as measuring the minimum deviation angle of a transparent prism. That is, when the optical bench is slightly rotated and the measurement light is observed, the moving direction of the light-spot is reversed at the extreme value. The detection is easy. Then, it is necessary to determine the complex refractive index from the measured local maximum deviation angle and its incident angle. These two angles are plotted parametrically by varying the real part of the refractive index under a fixed imaginary part. The similar curves are drawn under the fixed real parts. Each curve has a fixed value for the real or imaginary parts of the refractive index. Drawings of these many curves are made prior to measurement. Then we select the four curves that are closest to the local maximum deviation angle and its incident angle. Four fixed values attached to each of the four curves determine the complex index of refraction. Various liquids can be put in a prism container made of parallel plate glass and their local maximum deviation angles are measured. The method in this paper can easily determine the complex refractive index and can be used for material identification


title: Exploring Anisotropic Lorentz Invariance Violation from the Spectral-Lag Transitions of Gamma-Ray Bursts

abstract: The observed spectral lags of gamma-ray bursts (GRBs) have been widely used to explore possible violations of Lorentz invariance. However, these studies were generally performed by concentrating on the rough time lag of a single highest-energy photon and ignoring the intrinsic time lag at the source. A new way to test nonbirefringent Lorentz-violating effects has been proposed by analyzing the multi-photon spectral-lag behavior of a GRB that displays a positive-to-negative transition. This method gives both a plausible description of the intrinsic energy-dependent time lag and comparatively robust constraints on Lorentz-violating effects. In this work, we conduct a systematic search for Lorentz-violating photon dispersion from the spectral-lag transition features of 32 GRBs. By fitting the spectral-lag data of these 32 GRBs, we place constraints on a variety of isotropic and anisotropic Lorentz-violating coefficients with mass dimension $d=6$ and $8$. While our dispersion constraints are not competitive with existing bounds, they have the promise to complement the full coefficient space.


title: SQM2022: Theory Overview in Heavy-Ion Physics

abstract: An overview is presented of the many open, interesting questions regarding the behavior of matter at large temperatures and chemical potentials.


title: Multi-Scale Wavelet Transformer for Face Forgery Detection

abstract: Currently, many face forgery detection methods aggregate spatial and frequency features to enhance the generalization ability and gain promising performance under the cross-dataset scenario. However, these methods only leverage one level frequency information which limits their expressive ability. To overcome these limitations, we propose a multi-scale wavelet transformer framework for face forgery detection. Specifically, to take full advantage of the multi-scale and multi-frequency wavelet representation, we gradually aggregate the multi-scale wavelet representation at different stages of the backbone network. To better fuse the frequency feature with the spatial features, frequency-based spatial attention is designed to guide the spatial feature extractor to concentrate more on forgery traces. Meanwhile, cross-modality attention is proposed to fuse the frequency features with the spatial features. These two attention modules are calculated through a unified transformer block for efficiency. A wide variety of experiments demonstrate that the proposed method is efficient and effective for both within and cross datasets.


title: Bottleneck Analysis of Dynamic Graph Neural Network Inference on CPU and GPU

abstract: Dynamic graph neural network (DGNN) is becoming increasingly popular because of its widespread use in capturing dynamic features in the real world. A variety of dynamic graph neural networks designed from algorithmic perspectives have succeeded in incorporating temporal information into graph processing. Despite the promising algorithmic performance, deploying DGNNs on hardware presents additional challenges due to the model complexity, diversity, and the nature of the time dependency. Meanwhile, the differences between DGNNs and static graph neural networks make hardware-related optimizations for static graph neural networks unsuitable for DGNNs. In this paper, we select eight prevailing DGNNs with different characteristics and profile them on both CPU and GPU. The profiling results are summarized and analyzed, providing in-depth insights into the bottlenecks of DGNNs on hardware and identifying potential optimization opportunities for future DGNN acceleration. Followed by a comprehensive survey, we provide a detailed analysis of DGNN performance bottlenecks on hardware, including temporal data dependency, workload imbalance, data movement, and GPU warm-up. We suggest several optimizations from both software and hardware perspectives. This paper is the first to provide an in-depth analysis of the hardware performance of DGNN Code is available at https://github.com/sharc-lab/DGNN_analysis.


title: A fairness assessment of mobility-based COVID-19 case prediction models

abstract: In light of the outbreak of COVID-19, analyzing and measuring human mobility has become increasingly important. A wide range of studies have explored spatiotemporal trends over time, examined associations with other variables, evaluated non-pharmacologic interventions (NPIs), and predicted or simulated COVID-19 spread using mobility data. Despite the benefits of publicly available mobility data, a key question remains unanswered: are models using mobility data performing equitably across demographic groups? We hypothesize that bias in the mobility data used to train the predictive models might lead to unfairly less accurate predictions for certain demographic groups. To test our hypothesis, we applied two mobility-based COVID infection prediction models at the county level in the United States using SafeGraph data, and correlated model performance with sociodemographic traits. Findings revealed that there is a systematic bias in models performance toward certain demographic characteristics. Specifically, the models tend to favor large, highly educated, wealthy, young, urban, and non-black-dominated counties. We hypothesize that the mobility data currently used by many predictive models tends to capture less information about older, poorer, non-white, and less educated regions, which in turn negatively impacts the accuracy of the COVID-19 prediction in these regions. Ultimately, this study points to the need of improved data collection and sampling approaches that allow for an accurate representation of the mobility patterns across demographic groups.


title: Analytical investigations on non-minimally coupled scalar fields outside neutral reflecting shells

abstract: We study the existence of scalar fields outside neutral reflecting shells. We consider static massive scalar fields non-minimally coupled to the Gauss-Bonnet invariant. We analytically investigated properties of scalar fields through the scalar field equation. In the small scalar field mass regime, we derive a compact resonance formula for the allowed masses of scalar fields in the composed scalar field and shell configurations.


title: Wholesale Market Participation of Storage with State-of-Charge Dependent Bids

abstract: Wholesale market participation of storage with state-of-charge (SoC) dependent bids results in a non-convex cost in a multi-interval economic dispatch, which requires a mixed-integer linear program in the market clearing. We show that the economic dispatch can be convexified to the standard linear program when the SoC-dependent bid satisfies the equal decremental-cost ratio (EDCR) condition. Such EDCR bids are shown to support individual rationalities of all market participants in both the day-ahead multi-interval economic dispatch under locational marginal pricing and the rolling-window look-ahead dispatch under temporal-locational marginal pricing in the real-time market. A numerical example is presented to demonstrate a higher profit margin with an SoC-dependent bid over that from an SoC-independent bid.


title: LW-ISP: A Lightweight Model with ISP and Deep Learning

abstract: The deep learning (DL)-based methods of low-level tasks have many advantages over the traditional camera in terms of hardware prospects, error accumulation and imaging effects. Recently, the application of deep learning to replace the image signal processing (ISP) pipeline has appeared one after another; however, there is still a long way to go towards real landing. In this paper, we show the possibility of learning-based method to achieve real-time high-performance processing in the ISP pipeline. We propose LW-ISP, a novel architecture designed to implicitly learn the image mapping from RAW data to RGB image. Based on U-Net architecture, we propose the fine-grained attention module and a plug-and-play upsampling block suitable for low-level tasks. In particular, we design a heterogeneous distillation algorithm to distill the implicit features and reconstruction information of the clean image, so as to guide the learning of the student model. Our experiments demonstrate that LW-ISP has achieved a 0.38 dB improvement in PSNR compared to the previous best method, while the model parameters and calculation have been reduced by 23 times and 81 times. The inference efficiency has been accelerated by at least 15 times. Without bells and whistles, LW-ISP has achieved quite competitive results in ISP subtasks including image denoising and enhancement.


title: Empirical Bayes Selection for Value Maximization

abstract: We study the problem of selecting the best $m$ units from a set of $n$ as $m / n \to \alpha \in (0, 1)$, where noisy, heteroskedastic measurements of the units' true values are available and the decision-maker wishes to maximize the average true value of the units selected. Given a parametric prior distribution, the empirical Bayes decision rule incurs $O_p(n^{-1})$ regret relative to the Bayesian oracle that knows the true prior. More generally, if the error in the estimated prior is of order $O_p(r_n)$, regret is $O_p(r_n^2)$. In this sense selecting the best units is easier than estimating their values. We show this regret bound is sharp in the parametric case, by giving an example in which it is attained. Using priors calibrated from a dataset of over four thousand internet experiments, we find that empirical Bayes methods perform well in practice for detecting the best treatments given only a modest number of experiments.


title: 5G NR-LTE Coexistence: Opportunities, Challenges, and Solutions

abstract: 5G New Radio (NR) promises to support diverse services such as enhanced mobile broadband (eMBB), ultra-reliable low-latency communication (URLLC), and massive machine-type communication (mMTC). This requires spectrum, most of which is occupied by 4G Long Term Evolution (LTE). Hence, network operators are expected to deploy 5G using the existing LTE infrastructure while migrating to NR. In addition, operators must support legacy LTE devices during the migration, so LTE and NR systems will coexist for the foreseeable future. In this article, we address LTE-NR coexistence starting with a review of both radio access technologies. We then describe the contributions by the 3rd Generation Partnership Project (3GPP) to solving the coexistence issue and catalog the major coexistence scenarios. Lastly, we introduce a novel spectrum sharing scheme that can be applied to the coexistence scenarios under study.


title: Learning the Network of Graphs for Graph Neural Networks

abstract: Graph neural networks (GNNs) have achieved great success in many scenarios with graph-structured data. However, in many real applications, there are three issues when applying GNNs: graphs are unknown, nodes have noisy features, and graphs contain noisy connections. Aiming at solving these problems, we propose a new graph neural network named as GL-GNN. Our model includes multiple sub-modules, each sub-module selects important data features and learn the corresponding key relation graph of data samples when graphs are unknown. GL-GNN further obtains the network of graphs by learning the network of sub-modules. The learned graphs are further fused using an aggregation method over the network of graphs. Our model solves the first issue by simultaneously learning multiple relation graphs of data samples as well as a relation network of graphs, and solves the second and the third issue by selecting important data features as well as important data sample relations. We compare our method with 14 baseline methods on seven datasets when the graph is unknown and 11 baseline methods on two datasets when the graph is known. The results show that our method achieves better accuracies than the baseline methods and is capable of selecting important features and graph edges from the dataset. Our code will be publicly available at \url{https://github.com/Looomo/GL-GNN}.


title: Variability Analysis of Isolated Intersections Through Case Study

abstract: Population and economic growth of urban areas have led to intensive use of private vehicles, thereby increasing traffic volume and congestion on roads. The traffic management in the city is a challenge for concerned authorities, and the signalized intersections are the primary interest of traffic management. Interpreting traffic patterns and current traffic signal operations can provide thorough insights to take appropriate actions. In this view, a comprehensive study is conducted at selected intersections from Tumakuru (tier-2 city), Karnataka, India. Data estimates traffic parameters such as saturation flow, composition, volume, and volume-to-capacity ratio. The statistical results currently confirm the stable traffic condition but do not ensure sustainability. The volume-to-capacity ratio is greater than 0.73 along three major arterial roads of study intersections, indicating congestion in the future as the traffic volume is increasing gradually, as per the Directorate of Urban Land Use and Transportation, Government of Karnataka. The statistical results obtained through the current study uphold the report. The empirical results showed 40% of green time wastage at one of the study intersections, which results in additional waiting delays, thereby increasing fuel consumption and emissions. The overall service level of the study intersections is of class C based on computed delay and volume-to-capacity ratio. The study suggests possible treatments for improving the service level at the intersection operations and sustaining the city's stable traffic condition. The study supports city traffic management authorities in identifying suitable treatment and implementing accordingly.


title: A Higher Purpose: Measuring Electricity Access Using High-Resolution Daytime Satellite Imagery

abstract: Governments and international organizations the world over are investing towards the goal of achieving universal energy access for improving socio-economic development. However, in developing settings, monitoring electrification efforts is typically inaccurate, infrequent, and expensive. In this work, we develop and present techniques for high-resolution monitoring of electrification progress at scale. Specifically, our 3 unique contributions are: (i) identifying areas with(out) electricity access, (ii) quantifying the extent of electrification in electrified areas (percentage/number of electrified structures), and (iii) differentiating between customer types in electrified regions (estimating the percentage/number of residential/non-residential electrified structures). We combine high-resolution 50 cm daytime satellite images with Convolutional Neural Networks (CNNs) to train a series of classification and regression models. We evaluate our models using unique ground truth datasets on building locations, building types (residential/non-residential), and building electrification status. Our classification models show a 92% accuracy in identifying electrified regions, 85% accuracy in estimating percent of (low/high) electrified buildings within the region, and 69% accuracy in differentiating between (low/high) percentage of electrified residential buildings. Our regressions show $R^2$ scores of 78% and 80% in estimating the number of electrified buildings and number of residential electrified building in images respectively. We also demonstrate the generalizability of our models in never-before-seen regions to assess their potential for consistent and high-resolution measurements of electrification in emerging economies, and conclude by highlighting opportunities for improvement.


title: Quantifying constraints determining independent activation on NMDA receptors mediated currents from evoked and spontaneous synaptic transmission at an individual synapse

abstract: A synapse acts on neural transmission through a chemical process called synapses fusion between pre-synaptic and post-synaptic terminals. Presynaptic terminals release neurotransmitters either in response to action potential or spontaneously independent of presynaptic activity. However, it is still unclear the mechanism of evoked and spontaneous neuro-transmission that activate on postsynaptic terminals. To address this question, we examined the possibility that spontaneous and evoked neurotransmissions using mathematical simulations. We aimed to address the biophysical constraints that may determine independent activation on N-methyl-D-asparate (NMDA) receptor mediated currents in response to evoked and spontaneous glutamate molecules releases. In order to identify the spatial relation between spontaneous and evoked glutamate release, we considered quantitative factors, such as size of synapses, inhomogeneity of diffusion mobility, geometry of synaptic cleft, and release rate of neurotransmitter. Simulation results showed that as a synaptic size is smaller and if the cleft space is more cohesive in the peripheral area than the centre area, then there is high possibility of having crosstalk of two signals released from center and edge. When a synaptic size is larger, the cleft space is more affinity in the central area than the external area, and if the geometry of fusion has a narrower space, then those produce more chances of independence of two modes of currents released from center and edge. The computed results match well with existing experimental findings and serve as a road map for further exploration to identify independence of evoked and spontaneous releases.


title: Signal Detection in MIMO Systems with Hardware Imperfections: Message Passing on Neural Networks

abstract: In this paper, we investigate signal detection in multiple-input-multiple-output (MIMO) communication systems with hardware impairments, such as power amplifier nonlinearity and in-phase/quadrature imbalance. To deal with the complex combined effects of hardware imperfections, neural network (NN) techniques, in particular deep neural networks (DNNs), have been studied to directly compensate for the impact of hardware impairments. However, it is difficult to train a DNN with limited pilot signals, hindering its practical applications. In this work, we investigate how to achieve efficient Bayesian signal detection in MIMO systems with hardware imperfections. Characterizing combined hardware imperfections often leads to complicated signal models, making Bayesian signal detection challenging. To address this issue, we first train an NN to "model" the MIMO system with hardware imperfections and then perform Bayesian inference based on the trained NN. Modelling the MIMO system with NN enables the design of NN architectures based on the signal flow of the MIMO system, minimizing the number of NN layers and parameters, which is crucial to achieving efficient training with limited pilot signals. We then represent the trained NN with a factor graph, and design an efficient message passing based Bayesian signal detector, leveraging the unitary approximate message passing (UAMP) algorithm. The implementation of a turbo receiver with the proposed Bayesian detector is also investigated. Extensive simulation results demonstrate that the proposed technique delivers remarkably better performance than state-of-the-art methods.


title: Performance of compact plastic scintillator strips with WLS-fiber and PMT/SiPM readout

abstract: This work presents the design and performance study of compact strips of plastic scintillator with WLS-fiber readout in a dimension of 0.1 * 0.02 * 2 m3, which evaluates as a candidate for cosmic-ray muon detector for JUNO-TAO. The strips coupling with 3-inch PMTs are measured and compared between the single-end and double-end readout options first, and the strip of double-end option coupling with SiPM is further measured and compared with the results of that with the PMTs. The performance of the strips determined by a detailed survey along their length with cosmic-ray muon after a detailed characterization of the used 3-inch PMTs and SiPMs.The proposed compact strip of plastic scintillator with WLS-fiber coupling with SiPM provides a good choice for cosmic-ray muon veto detector for limited detector dimension in particular.


title: Spatial predictions on physically constrained domains: Applications to Arctic sea salinity data

abstract: In this paper we predict sea surface salinity (SSS) in the Arctic Ocean based on satellite measurements. SSS is a crucial indicator for ongoing changes in the Arctic Ocean and can offer important insights about climate change. We particularly focus on areas of water mistakenly flagged as ice by satellite algorithms. To remove bias in the retrieval of salinity near sea ice, the algorithms use conservative ice masks, which result in considerable loss of data. We aim to produce realistic SSS values for such regions to obtain more complete understanding about the SSS surface over the Arctic Ocean and benefit future applications that may require SSS measurements near edges of sea ice or coasts. We propose a class of scalable nonstationary processes that can handle large data from satellite products and complex geometries of the Arctic Ocean. Barrier overlap-removal acyclic directed graph GP (BORA-GP) constructs sparse directed acyclic graphs (DAGs) with neighbors conforming to barriers and boundaries, enabling characterization of dependence in constrained domains. The BORA-GP models produce more sensible SSS values in regions without satellite measurements and show improved performance in various constrained domains in simulation studies compared to state-of-the-art alternatives. An R package is available at https://github.com/jinbora0720/boraGP.


title: Over-the-Air Split Learning with MIMO-Based Neural Network and Constellation-Based Activation

abstract: This paper investigates a communication-efficient split learning (SL) over multiple-input multiple-output (MIMO) communication system. In particular, we mathematically decompose the inter-layer connection of a neural network (NN) to a series of linear precoding and combining transformations using over-the-air computation (OAC), which synergistically form a linear layer in NNs. The precoding and combining matrices are trainable parameters in such a system, whereas the MIMO channel is implicit. The proposed system eliminates the implicit channel estimation through exploiting the channel reciprocity and properly casting the backpropagation process, significantly saving the system costs and further improving the overall efficiency. The practical constellation diagrams are used as the activation function to avoid sending arbitrary analog signals as in the traditional OAC system. Numerical results are illustrated to demonstrate the effectiveness of the proposed scheme.


title: Short Text Pre-training with Extended Token Classification for E-commerce Query Understanding

abstract: E-commerce query understanding is the process of inferring the shopping intent of customers by extracting semantic meaning from their search queries. The recent progress of pre-trained masked language models (MLM) in natural language processing is extremely attractive for developing effective query understanding models. Specifically, MLM learns contextual text embedding via recovering the masked tokens in the sentences. Such a pre-training process relies on the sufficient contextual information. It is, however, less effective for search queries, which are usually short text. When applying masking to short search queries, most contextual information is lost and the intent of the search queries may be changed. To mitigate the above issues for MLM pre-training on search queries, we propose a novel pre-training task specifically designed for short text, called Extended Token Classification (ETC). Instead of masking the input text, our approach extends the input by inserting tokens via a generator network, and trains a discriminator to identify which tokens are inserted in the extended input. We conduct experiments in an E-commerce store to demonstrate the effectiveness of ETC.


title: Low Error-Rate Approximate Multiplier Design for DNNs with Hardware-Driven Co-Optimization

abstract: In this paper, two approximate 3*3 multipliers are proposed and the synthesis results of the ASAP-7nm process library justify that they can reduce the area by 31.38% and 36.17%, and the power consumption by 36.73% and 35.66% compared with the exact multiplier, respectively. They can be aggregated with a 2*2 multiplier to produce an 8*8 multiplier with low error rate based on the distribution of DNN weights. We propose a hardware-driven software co-optimization method to improve the DNN accuracy by retraining. Based on the proposed two approximate 3-bit multipliers, three approximate 8-bit multipliers with low error-rate are designed for DNNs. Compared with the exact 8-bit unsigned multiplier, our design can achieve a significant advantage over other approximate multipliers on the public dataset.


title: Duality Theory for Exponential Utility--Based Hedging in the Almgren--Chriss Model

abstract: In this paper, we obtain a duality result for the exponential utility maximization problem where trading is subject to quadratic transaction costs and the investor is required to liquidate her position at the maturity date. As an application of the duality, we treat utility-based hedging in the Bachelier model. For European contingent claims with a quadratic payoff, we compute explicitly the optimal trading strategy.


title: Finding and Exploring Promising Search Space for the 0-1 Multidimensional Knapsack Problem

abstract: The 0-1 Multidimensional Knapsack Problem (MKP) is a classical NP-hard combinatorial optimization problem with many engineering applications. In this paper, we propose a novel algorithm combining evolutionary computation with the exact algorithm to solve the 0-1 MKP. It maintains a set of solutions and utilizes the information from the population to extract good partial assignments. To find high-quality solutions, an exact algorithm is applied to explore the promising search space specified by the good partial assignments. The new solutions are used to update the population. Thus, the good partial assignments evolve towards a better direction with the improvement of the population. Extensive experimentation with commonly used benchmark sets shows that our algorithm outperforms the state-of-the-art heuristic algorithms, TPTEA and DQPSO, as well as the commercial solver CPlex. It finds better solutions than the existing algorithms and provides new lower bounds for 10 large and hard instances.


title: CLIP-PAE: Projection-Augmentation Embedding to Extract Relevant Features for a Disentangled, Interpretable, and Controllable Text-Guided Face Manipulation

abstract: Recently introduced Contrastive Language-Image Pre-Training (CLIP) bridges images and text by embedding them into a joint latent space. This opens the door to ample literature that aims to manipulate an input image by providing a textual explanation. However, due to the discrepancy between image and text embeddings in the joint space, using text embeddings as the optimization target often introduces undesired artifacts in the resulting images. Disentanglement, interpretability, and controllability are also hard to guarantee for manipulation. To alleviate these problems, we propose to define corpus subspaces spanned by relevant prompts to capture specific image characteristics. We introduce CLIP Projection-Augmentation Embedding (PAE) as an optimization target to improve the performance of text-guided image manipulation. Our method is a simple and general paradigm that can be easily computed and adapted, and smoothly incorporated into any CLIP-based image manipulation algorithm. To demonstrate the effectiveness of our method, we conduct several theoretical and empirical studies. As a case study, we utilize the method for text-guided semantic face editing. We quantitatively and qualitatively demonstrate that PAE facilitates a more disentangled, interpretable, and controllable image manipulation with state-of-the-art quality and accuracy.


title: Detecting Label Errors in Token Classification Data

abstract: Mislabeled examples are a common issue in real-world data, particularly for tasks like token classification where many labels must be chosen on a fine-grained basis. Here we consider the task of finding sentences that contain label errors in token classification datasets. We study 11 different straightforward methods that score tokens/sentences based on the predicted class probabilities output by a (any) token classification model (trained via any procedure). In precision-recall evaluations based on real-world label errors in entity recognition data from CoNLL-2003, we identify a simple and effective method that consistently detects those sentences containing label errors when applied with different token classification models.


title: Data Selection: A General Principle for Building Small Interpretable Models

abstract: We present convincing empirical evidence for an effective and general strategy for building accurate small models. Such models are attractive for interpretability and also find use in resource-constrained environments. The strategy is to learn the training distribution and sample accordingly from the provided training data. The distribution learning algorithm is not a contribution of this work; our contribution is a rigorous demonstration of the broad utility of this strategy in various practical settings. We apply it to the tasks of (1) building cluster explanation trees, (2) prototype-based classification, and (3) classification using Random Forests, and show that it improves the accuracy of decades-old weak traditional baselines to be competitive with specialized modern techniques. This strategy is also versatile wrt the notion of model size. In the first two tasks, model size is considered to be number of leaves in the tree and the number of prototypes respectively. In the final task involving Random Forests, the strategy is shown to be effective even when model size comprises of more than one factor: number of trees and their maximum depth. Positive results using multiple datasets are presented that are shown to be statistically significant.


title: Reconstruction of classical skyrmions from Anderson towers: quantum Darwinism in action

abstract: The development of the quantum skyrmion concept is aimed at expanding the scope of the fundamental research and practical applications for classical topologically-protected magnetic textures, and potentially paves the way for creating new quantum technologies. Undoubtedly, this calls for establishing a connection between a classical skyrmion and its quantum counterpart: a skyrmion wave function is an intrinsically more complex object than a non-collinear configuration of classical spins representing the classical skyrmion. Up to date, such a quantum-classical relation was only established on the level of different physical observables, but not for classical and quantum states per se. In this work, we show that the classical skyrmion spin order can be reconstructed using only the low-energy part of the spectrum of the corresponding quantum spin Hamiltonian. This can be done by means of a flexible symmetry-free numerical realization of Anderson's idea of the towers of states (TOS) that allows one to study known, as well as unknown, classical spin configurations with a proper choice of the loss function. We show that the existence of the TOS in the spectrum of the quantum systems does not guarantee a priori that the classical skyrmion magnetization profile can be obtained as an outcome of the actual measurement. This procedure should be complemented by a proper decoherence mechanism due to the interaction with the environment. The later selects a specific combination of the TOS eigenfunctions before the measurement and, thus, ensures the transition from a highly-entangled quantum skyrmionic state to a classical non-collinear magnetic order that is measured in real experiments. The results obtained in the context of skyrmions allow us to take a fresh look at the problem of quantum antiferromagnetism.


title: Sparse Teachers Can Be Dense with Knowledge

abstract: Recent advances in distilling pretrained language models have discovered that, besides the expressiveness of knowledge, the student-friendliness should be taken into consideration to realize a truly knowledgable teacher. Based on a pilot study, we find that over-parameterized teachers can produce expressive yet student-unfriendly knowledge and are thus limited in overall knowledgableness. To remove the parameters that result in student-unfriendliness, we propose a sparse teacher trick under the guidance of an overall knowledgable score for each teacher parameter. The knowledgable score is essentially an interpolation of the expressiveness and student-friendliness scores. The aim is to ensure that the expressive parameters are retained while the student-unfriendly ones are removed. Extensive experiments on the GLUE benchmark show that the proposed sparse teachers can be dense with knowledge and lead to students with compelling performance in comparison with a series of competitive baselines.


title: Real McKay Correspondence: KR-Theory of Graded Kleinian Groups

abstract: This project considers the finite symmetry subgroups of the orthogonal group $\mathrm{O}(3) \subset \mathrm{GL}(3,\mathbb{R})$ and the index $2$ containments $G\lhd \widehat{G}$. The special orthogonal group $\mathrm{SO}(3) \subset \mathrm{SL}(3,\mathbb{R})$ admits a double cover from the spinor group $\mathrm{Spin}(3) \cong \mathrm{SU}(2) \subset \mathrm{SL}(2,\mathbb{C})$, and lifting our subgroups up preserves the network of containments. Those subgroups not contained in $\mathrm{SO}(3) \subset \mathrm{O}(3) $ are lifted to the pinor groups $\mathrm{Pin}_{\pm}(3)$ of which there are two choices. For the index $2$ containments $G\lhd \widehat{G}$, we calculate the Real and complex Frobenius-Schur indicators, and apply Dyson's classification of antilinear block structures to produce decorated McKay graphs for each case. We then explore $KR$-theory as introduced by Atiyah in 1966, which is a variant of topological $K$-theory for working with topological spaces equipped with an involution. The GIT quotient spaces $\mathbb{C}^2 // G$, can be equipped by an involution via the action of $\widehat{G} / G$. In 1983, Gonzalez-Sprinberg and Verdier showed how one can view the McKay correspondence as an isomorphism between the $G$-equivariant $K$-theory $K_G(\mathbb{C}^2)$ and the $K$-theory of the minimal resolution of the singularity $\widetilde{\mathbb{C}^2 // G}$. We use this to conjecture an analogous a form of the McKay correspondence for $C_2$-graded groups and $KR$-theory.


title: Contextual Modeling for 3D Dense Captioning on Point Clouds

abstract: 3D dense captioning, as an emerging vision-language task, aims to identify and locate each object from a set of point clouds and generate a distinctive natural language sentence for describing each located object. However, the existing methods mainly focus on mining inter-object relationship, while ignoring contextual information, especially the non-object details and background environment within the point clouds, thus leading to low-quality descriptions, such as inaccurate relative position information. In this paper, we make the first attempt to utilize the point clouds clustering features as the contextual information to supply the non-object details and background environment of the point clouds and incorporate them into the 3D dense captioning task. We propose two separate modules, namely the Global Context Modeling (GCM) and Local Context Modeling (LCM), in a coarse-to-fine manner to perform the contextual modeling of the point clouds. Specifically, the GCM module captures the inter-object relationship among all objects with global contextual information to obtain more complete scene information of the whole point clouds. The LCM module exploits the influence of the neighboring objects of the target object and local contextual information to enrich the object representations. With such global and local contextual modeling strategies, our proposed model can effectively characterize the object representations and contextual information and thereby generate comprehensive and detailed descriptions of the located objects. Extensive experiments on the ScanRefer and Nr3D datasets demonstrate that our proposed method sets a new record on the 3D dense captioning task, and verify the effectiveness of our raised contextual modeling of point clouds.


title: Secrecy Rate of the Cooperative RSMA-Aided UAV Downlink Relying on Optimal Relay Selection

abstract: The Cooperative Rate-Splitting (CRS) scheme, proposed evolves from conventional Rate Splitting (RS) and relies on forwarding a portion of the RS message by the relaying users. In terms of secrecy enhancement, it has been shown that CRS outperforms its non-cooperative counterpart for a two-user Multiple Input Single Output (MISO) Broadcast Channel (BC). Given the massive connectivity requirement of 6G, we have generalized the existing secure two-user CRS framework to the multi-user framework, where the highest-security users must be selected as the relay nodes. This paper addresses the problem of maximizing the Worst-Case Secrecy Rate (WCSR) in a UAV-aided downlink network where a multi-antenna UAV Base-Station (UAV-BS) serves a group of users in the presence of an external eavesdropper (Eve). We consider a practical scenario in which only imperfect channel state information of Eve is available at the UAV-BS. Accordingly, we conceive a robust and secure resource allocation algorithm, which maximizes the WCSR by jointly optimizing both the Secure Relaying User Selection (SRUS) and the network parameter allocation problem, including the RS transmit precoders, message splitting variables, time slot sharing and power allocation. To circumvent the resultant non-convexity owing to the discrete variables imposed by SRUS, we propose a two-stage algorithm where the SRUS and network parameter allocation are accomplished in two consecutive stages. With regard to the SRUS, we study both centralized and distributed protocols. On the other hand, for jointly optimizing the network parameter allocation we resort to the Sequential Parametric Convex Approximation (SPCA) algorithm. Our numerical results show that the proposed solution significantly outperforms the existing benchmarks for a wide range of network loads in terms of the WCSR.


title: APE: Aligning Pretrained Encoders to Quickly Learn Aligned Multimodal Representations

abstract: Recent advances in learning aligned multimodal representations have been primarily driven by training large neural networks on massive, noisy paired-modality datasets. In this work, we ask whether it is possible to achieve similar results with substantially less training time and data. We achieve this by taking advantage of existing pretrained unimodal encoders and careful curation of alignment data relevant to the downstream task of interest. We study a natural approach to aligning existing encoders via small auxiliary functions, and we find that this method is competitive with (or outperforms) state of the art in many settings while being less prone to overfitting, less costly to train, and more robust to distribution shift. With a properly chosen alignment distribution, our method surpasses prior state of the art for ImageNet zero-shot classification on public data while using two orders of magnitude less time and data and training 77% fewer parameters.


title: Accretion and Host-Galaxy Properties of 14 New "Changing-Look'' Active Galactic Nuclei Identified from the SDSS-V Survey

abstract: The widely accepted active galactic nucleus (AGN) paradigm has been recently challenged by the discovery of the so-called ``changing-look'' (CL) phenomenon characterized by spectral-type transitions. By comparing the SDSS-V and SDSS DR16 spectroscopic datasets, here we report the identification of 14 new CL-AGNs (redshift $z<0.5$) exhibiting spectral-type changes on a timescale of $\sim 10$yr. Follow-up spectroscopy was conducted with the Lick Shane 3m and Keck 10m telescopes for three of the objects. Detailed analysis of these spectra enables us to arrive at the following two main results. (1) By compiling a sample of 65 CL-AGNs with good measurements, we reinforce the previous claim that CL-AGNs tend to be biased against both a high Eddington ratio ($\lesssim 0.1$) and a high bolometric luminosity ($\lesssim 10^{46}\,\mathrm{erg\,s^{-1}}$). This bias suggests that the disk-wind broad-line-region model is a plausible explanation of the CL phenomenon. (2) The host galaxies of CL-AGNs tend to be dominated by intermediate stellar populations, which motivates us to propose that CL-AGNs are probably particular AGNs at a special evolutionary stage, such as a transition stage from ``feast'' to ``famine'' fueling of the supermassive black hole. In addition, with our spectra, we identify SDSS J025951.22+003744.2 as a new repeat CL narrow-line Seyfert 1 galaxy with a rapid ``turn-on'' timescale of $\sim 1$yr.


title: EgoTaskQA: Understanding Human Tasks in Egocentric Videos

abstract: Understanding human tasks through video observations is an essential capability of intelligent agents. The challenges of such capability lie in the difficulty of generating a detailed understanding of situated actions, their effects on object states (i.e., state changes), and their causal dependencies. These challenges are further aggravated by the natural parallelism from multi-tasking and partial observations in multi-agent collaboration. Most prior works leverage action localization or future prediction as an indirect metric for evaluating such task understanding from videos. To make a direct evaluation, we introduce the EgoTaskQA benchmark that provides a single home for the crucial dimensions of task understanding through question-answering on real-world egocentric videos. We meticulously design questions that target the understanding of (1) action dependencies and effects, (2) intents and goals, and (3) agents' beliefs about others. These questions are divided into four types, including descriptive (what status?), predictive (what will?), explanatory (what caused?), and counterfactual (what if?) to provide diagnostic analyses on spatial, temporal, and causal understandings of goal-oriented tasks. We evaluate state-of-the-art video reasoning models on our benchmark and show their significant gaps between humans in understanding complex goal-oriented egocentric videos. We hope this effort will drive the vision community to move onward with goal-oriented video understanding and reasoning.


title: Hierarchical Graph Transformer with Adaptive Node Sampling

abstract: The Transformer architecture has achieved remarkable success in a number of domains including natural language processing and computer vision. However, when it comes to graph-structured data, transformers have not achieved competitive performance, especially on large graphs. In this paper, we identify the main deficiencies of current graph transformers:(1) Existing node sampling strategies in Graph Transformers are agnostic to the graph characteristics and the training process. (2) Most sampling strategies only focus on local neighbors and neglect the long-range dependencies in the graph. We conduct experimental investigations on synthetic datasets to show that existing sampling strategies are sub-optimal. To tackle the aforementioned problems, we formulate the optimization strategies of node sampling in Graph Transformer as an adversary bandit problem, where the rewards are related to the attention weights and can vary in the training procedure. Meanwhile, we propose a hierarchical attention scheme with graph coarsening to capture the long-range interactions while reducing computational complexity. Finally, we conduct extensive experiments on real-world datasets to demonstrate the superiority of our method over existing graph transformers and popular GNNs.


title: A few new orders for D-optimal matrices

abstract: The first examples of D-optimal matrices of orders 222, 234, 258 and 278 are constructed.


title: A Finite Algorithm for the Realizabilty of a Delaunay Triangulation

abstract: The \emph{Delaunay graph} of a point set $P \subseteq \mathbb{R}^2$ is the plane graph with the vertex-set $P$ and the edge-set that contains $\{p,p'\}$ if there exists a disc whose intersection with $P$ is exactly $\{p,p'\}$. Accordingly, a triangulated graph $G$ is \emph{Delaunay realizable} if there exists a triangulation of the Delaunay graph of some $P \subseteq \mathbb{R}^2$, called a \emph{Delaunay triangulation} of $P$, that is isomorphic to $G$. The objective of \textsc{Delaunay Realization} is to compute a point set $P \subseteq \mathbb{R}^2$ that realizes a given graph $G$ (if such a $P$ exists). Known algorithms do not solve \textsc{Delaunay Realization} as they are non-constructive. Obtaining a constructive algorithm for \textsc{Delaunay Realization} was mentioned as an open problem by Hiroshima et al.~\cite{hiroshima2000}. We design an $n^{\mathcal{O}(n)}$-time constructive algorithm for \textsc{Delaunay Realization}. In fact, our algorithm outputs sets of points with {\em integer} coordinates.


title: Inverse set estimation and inversion of simultaneous confidence intervals

abstract: Motivated by the questions of risk assessment in climatology (temperature change in North America) and medicine (impact of statin usage and COVID-19 on hospitalized patients), we address the problem of estimating the set in the domain of a function whose image equals a predefined subset. Existing methods that construct confidence sets require strict assumptions. We generalize the estimation of such sets to dense and non-dense domains with protection against "data peeking" by proving that confidence sets of multiple levels can be simultaneously constructed with the desired confidence non-asymptotically through inverting simultaneous confidence bands. A non-parametric bootstrap algorithm and code are provided.


title: Automata Equipped with Auxiliary Data Structures and Regular Realizability Problems

abstract: We consider general computational models: one-way and two-way finite automata, and logarithmic space Turing machines, all equipped with an auxiliary data structure (ADS). The definition of an ADS is based on the language of protocols of work with the ADS. We describe the connection of automata-based models with ``Balloon automata'' that are another general formalization of automata equipped with an ADS presented by Hopcroft and Ullman in 1967. This definition establishes the connection between the non-emptiness problem for one-way automata with ADS, languages recognizable by nondeterministic log-space Turing machines equipped with the same ADS, and a regular realizability problem (NRR) for the language of ADS' protocols. The NRR problem is to verify whether the regular language on the input has a non-empty intersection with the language of protocols. The computational complexity of these problems (and languages) is the same up to log-space reductions.


title: Convergence and error analysis for pure collisional breakage equation

abstract: Collisional breakage in the particulate process has a lot of recent curiosity. We study the pure collisional breakage equation which is nonlinear in nature accompanied by locally bounded breakage kernel and collision kernel. The continuous equation is discretized using a finite volume scheme (FVS) and the weak convergence of the approximated solution towards the exact solution is analyzed for non-uniform mesh. The idea of the analysis is based on the weak $L^1$ compactness and a suitable stable condition on time step is introduced. Furthermore, theoretical error analysis is developed for a uniform mesh when kernels are taken in $W_{loc}^{1,\infty}$ space. The scheme is shown to be first-order convergent which is verified numerically for three test examples of the kernels.


title: Cloud Native Robotic Applications with GPU Sharing on Kubernetes

abstract: In this paper we discuss our experience in teaching the Robotic Applications Programming course at ZHAW combining the use of a Kubernetes (k8s) cluster and real, heterogeneous, robotic hardware. We discuss the main advantages of our solutions in terms of seamless simulation-to-real experience for students and the main shortcomings we encountered with networking and sharing GPUs to support deep learning workloads. We describe the current and foreseen alternatives to avoid these drawbacks in future course editions and propose a more cloud-native approach to deploying multiple robotics applications on a k8s cluster.


title: Geodesic planes in a geometrically finite end and the halo of a measured lamination

abstract: Recent works [MMO1, arXiv:1802.03853, arXiv:1802.04423, arXiv:2101.08956] have shed light on the topological behavior of geodesic planes in the convex core of a geometrically finite hyperbolic 3-manifolds $M$ of infinite volume. In this paper, we focus on the remaining case of geodesic planes outside the convex core of $M$, giving a complete classification of their closures in $M$. In particular, we show that the behavior is different depending on whether exotic roofs exist or not. Here an exotic roof is a geodesic plane contained in an end $E$ of $M$, which limits on the convex core boundary $\partial E$, but cannot be separated from the core by a support plane of $\partial E$. A necessary condition for the existence of exotic roofs is the existence of exotic rays for the bending lamination. Here an exotic ray is a geodesic ray that has finite intersection number with a measured lamination $\mathcal{L}$ but is not asymptotic to any leaf nor eventually disjoint from $\mathcal{L}$. We establish that exotic rays exist if and only if $\mathcal{L}$ is not a multicurve. The proof is constructive, and the ideas involved are important in the construction of exotic roofs. We also show that the existence of geodesic rays satisfying a stronger condition than being exotic, phrased in terms of only the hyperbolic surface $\partial E$ and the bending lamination, is sufficient for the existence of exotic roofs. As a result, we show that geometrically finite ends with exotic roofs exist in every genus. Moreover, in genus $1$, when the end is homotopic to a punctured torus, a generic one (in the sense of Baire category) contains uncountably many exotic roofs.


title: An exact relaxation of AC-OPF problem for battery-integrated power grids

abstract: Renewable energy resources and power electronics-interfaced loads introduce fast dynamics in distribution networks. These dynamics cannot be regulated by slow conventional solutions and require fast controllable energy resources such as Battery Energy Storage Systems (BESSs). To compensate for the high costs associated to BESSs, their energy and power management should be optimized. In this paper, a convex iterative optimization approach is developed to find the optimal active and reactive power setpoints of BESSs in active distribution networks. The objective is to minimize the total cost of energy purchase from the grid. Round-trip and life-time characteristics of BESSs are modelled accurately and integrated into a relaxed and exact formulation of the AC power flow, resulting into a Modified Augmented Relaxed Optimal Power Flow (MAROP) problem. The feasibility and optimality of the solution under the grid security limits and technical constraints of BESSs is proven analytically. A 32-bus IEEE test benchmark is used to illustrate the performance of the developed approach in comparison to the alternative approaches existing in the literature.


title: On the fine structure and hierarchy of gradient catastrophes for multidimensional homogeneous Euler equation

abstract: Blow-ups of derivatives and gradient catastrophes for the $n$-dimensional homogeneous Euler equation are discussed. It is shown that, in the case of generic initial data, the blow-ups exhibit a fine structure in accordance of the admissible ranks of certain matrix generated by the initial data. Blow-ups form a hierarchy composed by $n+1$ levels with the strongest singularity of derivatives given by $\partial u_i/\partial x_k \sim |\delta \mathbf{x}|^{-(n+1)/(n+2)}$ along certain critical directions. It is demonstrated that in the multi-dimensional case there are certain bounded linear superposition of blow-up derivatives. Particular results for the potential motion are presented too. Hodograph equations are basic tools of the analysis.


title: Hierarchical Few-Shot Object Detection: Problem, Benchmark and Method

abstract: Few-shot object detection (FSOD) is to detect objects with a few examples. However, existing FSOD methods do not consider hierarchical fine-grained category structures of objects that exist widely in real life. For example, animals are taxonomically classified into orders, families, genera and species etc. In this paper, we propose and solve a new problem called hierarchical few-shot object detection (Hi-FSOD), which aims to detect objects with hierarchical categories in the FSOD paradigm. To this end, on the one hand, we build the first large-scale and high-quality Hi-FSOD benchmark dataset HiFSOD-Bird, which contains 176,350 wild-bird images falling to 1,432 categories. All the categories are organized into a 4-level taxonomy, consisting of 32 orders, 132 families, 572 genera and 1,432 species. On the other hand, we propose the first Hi-FSOD method HiCLPL, where a hierarchical contrastive learning approach is developed to constrain the feature space so that the feature distribution of objects is consistent with the hierarchical taxonomy and the model's generalization power is strengthened. Meanwhile, a probabilistic loss is designed to enable the child nodes to correct the classification errors of their parent nodes in the taxonomy. Extensive experiments on the benchmark dataset HiFSOD-Bird show that our method HiCLPL outperforms the existing FSOD methods.


title: Learning Fine-Grained Visual Understanding for Video Question Answering via Decoupling Spatial-Temporal Modeling

abstract: While recent large-scale video-language pre-training made great progress in video question answering, the design of spatial modeling of video-language models is less fine-grained than that of image-language models; existing practices of temporal modeling also suffer from weak and noisy alignment between modalities. To learn fine-grained visual understanding, we decouple spatial-temporal modeling and propose a hybrid pipeline, Decoupled Spatial-Temporal Encoders, integrating an image- and a video-language encoder. The former encodes spatial semantics from larger but sparsely sampled frames independently of time, while the latter models temporal dynamics at lower spatial but higher temporal resolution. To help the video-language model learn temporal relations for video QA, we propose a novel pre-training objective, Temporal Referring Modeling, which requires the model to identify temporal positions of events in video sequences. Extensive experiments demonstrate that our model outperforms previous work pre-trained on orders of magnitude larger datasets.


title: Point Cloud Upsampling via Cascaded Refinement Network

abstract: Point cloud upsampling focuses on generating a dense, uniform and proximity-to-surface point set. Most previous approaches accomplish these objectives by carefully designing a single-stage network, which makes it still challenging to generate a high-fidelity point distribution. Instead, upsampling point cloud in a coarse-to-fine manner is a decent solution. However, existing coarse-to-fine upsampling methods require extra training strategies, which are complicated and time-consuming during the training. In this paper, we propose a simple yet effective cascaded refinement network, consisting of three generation stages that have the same network architecture but achieve different objectives. Specifically, the first two upsampling stages generate the dense but coarse points progressively, while the last refinement stage further adjust the coarse points to a better position. To mitigate the learning conflicts between multiple stages and decrease the difficulty of regressing new points, we encourage each stage to predict the point offsets with respect to the input shape. In this manner, the proposed cascaded refinement network can be easily optimized without extra learning strategies. Moreover, we design a transformer-based feature extraction module to learn the informative global and local shape context. In inference phase, we can dynamically adjust the model efficiency and effectiveness, depending on the available computational resources. Extensive experiments on both synthetic and real-scanned datasets demonstrate that the proposed approach outperforms the existing state-of-the-art methods.


title: Design and Analysis of Optimized Portfolios for Selected Sectors of the Indian Stock Market

abstract: Portfolio optimization is a challenging problem that has attracted considerable attention and effort from researchers. The optimization of stock portfolios is a particularly hard problem since the stock prices are volatile and estimation of their future volatilities and values, in most cases, is very difficult, if not impossible. This work uses three ratios, the Sharpe ratio, the Sortino ratio, and the Calmar ratio, for designing the mean-variance optimized portfolios for six important sectors listed in the National Stock Exchange (NSE) of India. Three portfolios are designed for each sector maximizing the ratios based on the historical prices of the ten most important stocks of each sector from Jan 1, 2017, to Dec 31, 2020. The evaluation of the portfolios is done based on their cumulative returns over the test period from Jan 1, 2021, to Dec 31, 2021. The ratio that yields the maximum cumulative returns for both the training and the test periods for the majority of the sectors is identified. The sectors that exhibit the maximum cumulative returns for the same ratio are also identified. The results provide useful insights for investors in the stock market in making their investment decisions based on the current return and risks associated with the six sectors and their stocks.


title: Effect of Earth-Moon's gravity on TianQin's range acceleration noise. II. Impact of orbit selection

abstract: The paper is a sequel to our previous work (Zhang et al. Phys. Rev. D 103, 062001 (2021)). For proposed geocentric space-based gravitational wave detectors such as TianQin, gLISA, and GADFLI, the gravity-field disturbances, i.e., the so called ``orbital noise'', from the Earth-Moon system on the sensitive intersatellite laser interferometric measurements should be carefully evaluated and taken into account in the concept studies. Based on TianQin, we investigate how the effect, in terms of frequency spectra, varies with different choices of orbital orientations and radii through single-variable studies, and present the corresponding roll-off frequencies that may set the lower bounds of the targeted detection bands. The results, including the special cases of geostationary orbits (gLISA/GADFLI) and repeat orbits, can provide a useful input to orbit and constellation design for future geocentric missions.


title: Understanding HTML with Large Language Models

abstract: Large language models (LLMs) have shown exceptional performance on a variety of natural language tasks. Yet, their capabilities for HTML understanding -- i.e., parsing the raw HTML of a webpage, with applications to automation of web-based tasks, crawling, and browser-assisted retrieval -- have not been fully explored. We contribute HTML understanding models (fine-tuned LLMs) and an in-depth analysis of their capabilities under three tasks: (i) Semantic Classification of HTML elements, (ii) Description Generation for HTML inputs, and (iii) Autonomous Web Navigation of HTML pages. While previous work has developed dedicated architectures and training procedures for HTML understanding, we show that LLMs pretrained on standard natural language corpora transfer remarkably well to HTML understanding tasks. For instance, fine-tuned LLMs are 12% more accurate at semantic classification compared to models trained exclusively on the task dataset. Moreover, when fine-tuned on data from the MiniWoB benchmark, LLMs successfully complete 50% more tasks using 192x less data compared to the previous best supervised model. Out of the LLMs we evaluate, we show evidence that T5-based models are ideal due to their bidirectional encoder-decoder architecture. To promote further research on LLMs for HTML understanding, we create and open-source a large-scale HTML dataset distilled and auto-labeled from CommonCrawl.


title: A Concrete Example of Fractional Chern Insulator

abstract: We present a concrete example of fractional Chern insulator whose fermion Hamiltonian consists of hopping and Coulomb repulsive interaction terms. Both of them are of finite range on the square lattice. In a strong coupling limit for the interaction Hamiltonian, we show that the Hall conductance is fractionally quantized to $1/2$ in the sense of the expectation value with respect to the four-fold degenerate ground state at the filling $3/8$. We also present a slightly different example in which there appears a long-range order of charge density wave with the Chern number $1$.


title: Finite-Time Convergent Algorithms for Time-Varying Distributed Optimization

abstract: This paper focuses on finite-time (FT) convergent distributed algorithms for solving time-varying (TV) distributed optimization (TVDO). The objective is to minimize the sum of local TV cost functions subject to the possible TV constraints by the coordination of multiple agents in finite time. Specifically, two classes of TVDO are investigated included unconstrained distributed consensus optimization and distributed optimal resource allocation problems (DORAP) with both TV cost functions and coupled equation constraints. For the previous one, based on non-smooth analysis, a continuous-time distributed discontinuous dynamics with FT convergence is proposed based on an extended zero-gradient-sum method with a local auxiliary subsystem. Then, an FT convergent distributed dynamics is further obtained for TV-DORAP by dual transformation. Particularly, the inversion of the cost functions' Hessians is not required in the dual variables' dynamics, while another local optimization needs to be solved to obtain the primal variable at each time instant. Finally, two numerical examples are conducted to verify the proposed algorithms.


title: Optimizing the Placement and Beamforming of RIS in Cellular Networks: A System-Level Modeling Perspective

abstract: In this letter, we present in detail the system-level modeling of reconfigurable intelligent surface (RIS)-assisted cellular systems by considering a 3-dimensional channel model between base station, RIS, and user. We prove that the optimal placement of RIS to achieve wider coverage is exactly opposite to the base station, under the constraint of single RIS in each sector. We propose a novel beamforming design for RIS-assisted cellular systems and derive the achievable sum rate in the presence of ideal, discrete, and random phase shifters at RIS. Through extensive system-level evaluations, we then show that the proposed beamforming design achieves significant improvements as compared to the state-of-the-art algorithms.


title: ConstGCN: Constrained Transmission-based Graph Convolutional Networks for Document-level Relation Extraction

abstract: Document-level relation extraction with graph neural networks faces a fundamental graph construction gap between training and inference - the golden graph structure only available during training, which causes that most methods adopt heuristic or syntactic rules to construct a prior graph as a pseudo proxy. In this paper, we propose $\textbf{ConstGCN}$, a novel graph convolutional network which performs knowledge-based information propagation between entities along with all specific relation spaces without any prior graph construction. Specifically, it updates the entity representation by aggregating information from all other entities along with each relation space, thus modeling the relation-aware spatial information. To control the information flow passing through the indeterminate relation spaces, we propose to constrain the propagation using transmitting scores learned from the Noise Contrastive Estimation between fact triples. Experimental results show that our method outperforms the previous state-of-the-art (SOTA) approaches on the DocRE dataset.


title: Plasma noise in TianQin time delay interferometry

abstract: TianQin is a proposed geocentric space-based gravitational wave observatory mission, which requires time-delay interferometry (TDI) to cancel laser frequency noise. With high demands for precision, solar-wind plasma environment at $\sim 10^5$ km above the Earth may constitute a non-negligible noise source to laser interferometric measurements between satellites, as charged particles perturb the refractivity along light paths. In this paper, we first assess the plasma noises along single links from space-weather models and numerical orbits, and analyze the time and frequency domain characteristics. Particularly, to capture the plasma noise in the entire measurement band of $10^{-4} - 1$ Hz, we have performed additional space-weather magnetohydrodynamic simulations in finer spatial and temporal resolutions and utilized Kolmogorov spectra in high-frequency data generation. Then we evaluate the residual plasma noises of the first- and second-generation TDI combinations. Both analytical and numerical estimations have shown that under normal solar conditions the plasma noise after TDI is less than the secondary noise requirement. Moreover, TDI is shown to exhibit moderate suppression on the plasma noise below $\sim 10^{-2}$ Hz due to noise correlation between different arms, when compared with the secondary noise before and after TDI.


title: ArabSign: A Multi-modality Dataset and Benchmark for Continuous Arabic Sign Language Recognition

abstract: Sign language recognition has attracted the interest of researchers in recent years. While numerous approaches have been proposed for European and Asian sign languages recognition, very limited attempts have been made to develop similar systems for the Arabic sign language (ArSL). This can be attributed partly to the lack of a dataset at the sentence level. In this paper, we aim to make a significant contribution by proposing ArabSign, a continuous ArSL dataset. The proposed dataset consists of 9,335 samples performed by 6 signers. The total time of the recorded sentences is around 10 hours and the average sentence's length is 3.1 signs. ArabSign dataset was recorded using a Kinect V2 camera that provides three types of information (color, depth, and skeleton joint points) recorded simultaneously for each sentence. In addition, we provide the annotation of the dataset according to ArSL and Arabic language structures that can help in studying the linguistic characteristics of ArSL. To benchmark this dataset, we propose an encoder-decoder model for Continuous ArSL recognition. The model has been evaluated on the proposed dataset, and the obtained results show that the encoder-decoder model outperformed the attention mechanism with an average word error rate (WER) of 0.50 compared with 0.62 with the attention mechanism. The data and code are available at github.com/Hamzah-Luqman/ArabSign


title: Detaching and Boosting: Dual Engine for Scale-Invariant Self-Supervised Monocular Depth Estimation

abstract: Monocular depth estimation (MDE) in the self-supervised scenario has emerged as a promising method as it refrains from the requirement of ground truth depth. Despite continuous efforts, MDE is still sensitive to scale changes especially when all the training samples are from one single camera. Meanwhile, it deteriorates further since camera movement results in heavy coupling between the predicted depth and the scale change. In this paper, we present a scale-invariant approach for self-supervised MDE, in which scale-sensitive features (SSFs) are detached away while scale-invariant features (SIFs) are boosted further. To be specific, a simple but effective data augmentation by imitating the camera zooming process is proposed to detach SSFs, making the model robust to scale changes. Besides, a dynamic cross-attention module is designed to boost SIFs by fusing multi-scale cross-attention features adaptively. Extensive experiments on the KITTI dataset demonstrate that the detaching and boosting strategies are mutually complementary in MDE and our approach achieves new State-of-The-Art performance against existing works from 0.097 to 0.090 w.r.t absolute relative error. The code will be made public soon.


title: Non-Monotonic Latent Alignments for CTC-Based Non-Autoregressive Machine Translation

abstract: Non-autoregressive translation (NAT) models are typically trained with the cross-entropy loss, which forces the model outputs to be aligned verbatim with the target sentence and will highly penalize small shifts in word positions. Latent alignment models relax the explicit alignment by marginalizing out all monotonic latent alignments with the CTC loss. However, they cannot handle non-monotonic alignments, which is non-negligible as there is typically global word reordering in machine translation. In this work, we explore non-monotonic latent alignments for NAT. We extend the alignment space to non-monotonic alignments to allow for the global word reordering and further consider all alignments that overlap with the target sentence. We non-monotonically match the alignments to the target sentence and train the latent alignment model to maximize the F1 score of non-monotonic matching. Extensive experiments on major WMT benchmarks show that our method substantially improves the translation performance of CTC-based models. Our best model achieves 30.06 BLEU on WMT14 En-De with only one-iteration decoding, closing the gap between non-autoregressive and autoregressive models.


title: Contact-aware Human Motion Forecasting

abstract: In this paper, we tackle the task of scene-aware 3D human motion forecasting, which consists of predicting future human poses given a 3D scene and a past human motion. A key challenge of this task is to ensure consistency between the human and the scene, accounting for human-scene interactions. Previous attempts to do so model such interactions only implicitly, and thus tend to produce artifacts such as "ghost motion" because of the lack of explicit constraints between the local poses and the global motion. Here, by contrast, we propose to explicitly model the human-scene contacts. To this end, we introduce distance-based contact maps that capture the contact relationships between every joint and every 3D scene point at each time instant. We then develop a two-stage pipeline that first predicts the future contact maps from the past ones and the scene point cloud, and then forecasts the future human poses by conditioning them on the predicted contact maps. During training, we explicitly encourage consistency between the global motion and the local poses via a prior defined using the contact maps and future poses. Our approach outperforms the state-of-the-art human motion forecasting and human synthesis methods on both synthetic and real datasets. Our code is available at https://github.com/wei-mao-2019/ContAwareMotionPred.


title: Sums of two square-zero selfadjoint or skew-selfadjoint endomorphisms

abstract: Let $V$ be a finite-dimensional vector space over a field $\mathbb{F}$, equipped with a symmetric or alternating non-degenerate bilinear form $b$. When the characteristic of $\mathbb{F}$ is not $2$, we characterize the endomorphisms $u$ of $V$ that split into $u=a_1+a_2$ for some pair $(a_1,a_2)$ of $b$-selfadjoint (respectively, $b$-skew-selfadjoint) endomorphisms of $V$ such that $(a_1)^2=(a_2)^2=0$. In the characteristic $2$ case, we obtain a similar classification for the endomorphisms of $V$ that split into the sum of two square-zero $b$-alternating endomorphisms of $V$ when $b$ is alternating (an endomorphism $v$ is called $b$-alternating whenever $b(x,v(x))=0$ for all $x \in V$). Finally, if the field $\mathbb{F}$ is equipped with a non-identity involution, we characterize the pairs $(h,u)$ in which $h$ is a Hermitian form on a finite-dimensional space over $\mathbb{F}$, and $u$ is the sum of two square-zero $h$-selfadjoint endomorphisms.


title: Robust Graph Structure Learning via Multiple Statistical Tests

abstract: Graph structure learning aims to learn connectivity in a graph from data. It is particularly important for many computer vision related tasks since no explicit graph structure is available for images for most cases. A natural way to construct a graph among images is to treat each image as a node and assign pairwise image similarities as weights to corresponding edges. It is well known that pairwise similarities between images are sensitive to the noise in feature representations, leading to unreliable graph structures. We address this problem from the viewpoint of statistical tests. By viewing the feature vector of each node as an independent sample, the decision of whether creating an edge between two nodes based on their similarity in feature representation can be thought as a ${\it single}$ statistical test. To improve the robustness in the decision of creating an edge, multiple samples are drawn and integrated by ${\it multiple}$ statistical tests to generate a more reliable similarity measure, consequentially more reliable graph structure. The corresponding elegant matrix form named $\mathcal{B}\textbf{-Attention}$ is designed for efficiency. The effectiveness of multiple tests for graph structure learning is verified both theoretically and empirically on multiple clustering and ReID benchmark datasets. Source codes are available at https://github.com/Thomas-wyh/B-Attention.


title: Magnetohydrodynamics evolution of three-dimensional magnetic null in NOAA active region 11515 initiated using non-force-free field extrapolation

abstract: Magnetohydrodynamics simulation of active region NOAA 11515 is performed to examine the initiation of the M5.6 flaring event that starts around 10:43 UT on 2012 July 2. The simulation is conducted using an extrapolated non-force-free magnetic field generated from the photospheric vector magnetogram of the active region as the initial magnetic field. The magnetic field shows the presence of a three-dimensional (3D) magnetic null with the corresponding dome overlying a filament and a low-lying magnetic flux rope, observed in 304~\AA~ and 131~\AA~ respectively. The simulated dynamics, triggered by the initial Lorentz force, lead to the bifurcations of the flux rope, which is similar to the observed bifurcation in the 131 \AA~ brightenings. Additionally, the rope exhibits a rise and reconnects at the 3D null. These reconnections convert field lines of the rope into the anchored outer spine of the 3D null -- explaining the occurrence of a nearby confined C-class flare. Further, the results show that the field lines of the flux rope reach the vicinity of the filament and become non-parallel to the field lines of the filament. This initiates the reconnections between the rope and the field lines of the filament -- activating the filament for the eruption. This interesting interaction of the flux rope and filament seems to contribute to the onset of the M-class flare.


title: Online Schema Evolution is (Almost) Free for Snapshot Databases

abstract: Modern database applications often change their schemas to keep up with the changing requirements. However, support for online and transactional schema evolution remains challenging in existing database systems. Specifically, prior work often takes ad hoc approaches to schema evolution with 'patches' applied to existing systems, leading to many corner cases and often incomplete functionality. Applications therefore often have to carefully schedule downtimes for schema changes, sacrificing availability. This paper presents Tesseract, a new approach to online and transactional schema evolution without the aforementioned drawbacks. We design Tesseract based on a key observation: in widely used multi-versioned database systems, schema evolution can be modeled as data modification operations that change the entire table, i.e., data-definition-as-modification (DDaM). This allows us to support schema almost 'for free' by leveraging the concurrency control protocol. By simple tweaks to existing snapshot isolation protocols, on a 40-core server we show that under a variety of workloads, Tesseract is able to provide online, transactional schema evolution without service downtime, and retain high application performance when schema evolution is in progress.


title: On two cycles of consecutive even lengths

abstract: Bondy and Vince showed that every graph with minimum degree at least three contains two cycles of lengths differing by one or two.We prove the following average degree counterpart that every $n$-vertex graph $G$ with at least $\frac52(n-1)$ edges, unless $4|(n-1)$ and every block of $G$ is a clique $K_5$, contains two cycles of consecutive even lengths. Our proof is mainly based on structural analysis, and a crucial step which may be of independent interest shows that the same conclusion holds for every 3-connected graph with at least 6 vertices. This solves a special case of a conjecture of Verstra\"ete. The quantitative bound is tight and also provides the optimal extremal number for cycles of length two modulo four.


title: Theory of Optical Activity in Doped Systems with Application to Twisted Bilayer Graphene

abstract: We theoretically study the optical activity in a doped system and derive the optical activity tensor from a light wavevector-dependent linear optical conductivity. Although the light-matter interaction is introduced through the velocity gauge from a minimal coupling Hamiltonian, we find that the well-known ``false divergences'' problem can be avoided in practice if the electronic states are described by a finite band effective Hamiltonian, such as a few-band tight-binding model. The expression we obtain for the optical activity tensor is in good numerical agreement with a recent theory derived for an undoped topologically trivial gapped system. We apply our theory to the optical activity of a gated twisted bilayer graphene, with a detailed discussion of the dependence of the results on twist angle, chemical potential, gate voltage, and location of rotation center forming the twisted bilayer graphene.


title: Dynamic Tensor Product Regression

abstract: In this work, we initiate the study of \emph{Dynamic Tensor Product Regression}. One has matrices $A_1\in \mathbb{R}^{n_1\times d_1},\ldots,A_q\in \mathbb{R}^{n_q\times d_q}$ and a label vector $b\in \mathbb{R}^{n_1\ldots n_q}$, and the goal is to solve the regression problem with the design matrix $A$ being the tensor product of the matrices $A_1, A_2, \dots, A_q$ i.e. $\min_{x\in \mathbb{R}^{d_1\ldots d_q}}~\|(A_1\otimes \ldots\otimes A_q)x-b\|_2$. At each time step, one matrix $A_i$ receives a sparse change, and the goal is to maintain a sketch of the tensor product $A_1\otimes\ldots \otimes A_q$ so that the regression solution can be updated quickly. Recomputing the solution from scratch for each round is very slow and so it is important to develop algorithms which can quickly update the solution with the new design matrix. Our main result is a dynamic tree data structure where any update to a single matrix can be propagated quickly throughout the tree. We show that our data structure can be used to solve dynamic versions of not only Tensor Product Regression, but also Tensor Product Spline regression (which is a generalization of ridge regression) and for maintaining Low Rank Approximations for the tensor product.


title: Low-Power Random Access for Timely Status Update: Packet-based or Connection-based?

abstract: This paper studies low-power random access protocols for timely status update systems with information freshness requirements, measured by age of information (AoI). In an extensive network, a fundamental challenge is scheduling a large number of transmitters to access the wireless channel in a way that achieves low network-wide AoI while consuming minimal power. Conventional packet-based random access protocols involve transmitters contending for the channel by sending their entire data packets. When the packet duration is long, the time wasted due to packet collisions can be significant. In contrast, connection-based random access protocols establish connections with the receiver before transmitting data packets. From an information freshness perspective, there should be conditions that favor one approach over the other. We present a comparative study of the average AoI of packet-based and connection-based random access protocols. Specifically, we consider frame slotted Aloha (FSA) as a representative of packet-based random access and design a request-then-access (RTA) protocol for connection-based random access. Our analyses indicate that the choice between packet-based or connection-based protocols depends mainly on the payload size of update packets and the transmit power budget. In particular, RTA saves power and significantly reduces AoI, especially when the payload size is large. Overall, our investigation offers insights into the practical design of random access protocols for low-power timely status update systems.


title: SDA: Simple Discrete Augmentation for Contrastive Sentence Representation Learning

abstract: Contrastive learning has recently achieved compelling performance in unsupervised sentence representation. As an essential element, data augmentation protocols, however, have not been well explored. The pioneering work SimCSE resorting to a simple dropout mechanism (viewed as continuous augmentation) surprisingly dominates discrete augmentations such as cropping, word deletion, and synonym replacement as reported. To understand the underlying rationales, we revisit existing approaches and attempt to hypothesize the desiderata of reasonable data augmentation methods: balance of semantic consistency and expression diversity. We then develop three simple yet effective discrete sentence augmentation schemes: punctuation insertion, modal verbs, and double negation. They act as minimal noises at lexical level to produce diverse forms of sentences. Furthermore, standard negation is capitalized on to generate negative samples for alleviating feature suppression involved in contrastive learning. We experimented extensively with semantic textual similarity on diverse datasets. The results support the superiority of the proposed methods consistently. Our key code is available at https://github.com/Zhudongsheng75/SDA


title: An Efficient and Continuous Voronoi Density Estimator

abstract: We introduce a non-parametric density estimator deemed Radial Voronoi Density Estimator (RVDE). RVDE is grounded in the geometry of Voronoi tessellations and as such benefits from local geometric adaptiveness and broad convergence properties. Due to its radial definition RVDE is continuous and computable in linear time with respect to the dataset size. This amends for the main shortcomings of previously studied VDEs, which are highly discontinuous and computationally expensive. We provide a theoretical study of the modes of RVDE as well as an empirical investigation of its performance on high-dimensional data. Results show that RVDE outperforms other non-parametric density estimators, including recently introduced VDEs.


title: Yang-Baxter algebra, higher rank partition functions and $K$-theoretic Gysin map for partial flag bundles

abstract: We investigate the $K$-theoretic Gysin map for type $A$ partial flag bundles from the viewpoint of integrability. We introduce several types of partition functions for one version of $q=0$ degeneration of $U_q(\widehat{sl_n})$ vertex models on rectangular grids which differ by boundary conditions and sizes, and can be viewed as Grothendieck classes of the Grothendieck group of a nonsingular variety and partial flag bundles. By deriving multiple commutation relations for the $q=0$ $U_q(\widehat{sl_n})$ Yang-Baxter algebra and combining with the description of the $K$-theoretic Gysin map for partial flag bundles using symmetrizing operators, we show that the $K$-theoretic Gysin map of the first type of partition functions on a rectangular grid is given by the second type whose boundary conditions on one side are reversed from the first type. This generalizes the author's previous result from Grassmann bundles to partial flag bundles. We also discuss the inhomogenous version of the partition functions and applications to the $K$-theoretic Gysin map.


title: No-Go Theorems for Hairy Black Holes in Scalar- or Vector-Tensor-Gauss-Bonnet Theory

abstract: In this paper, we show a no-go theorem for static spherically symmetric black holes with vector hair in Einstein-$\Lambda$-Vector-Tensor-Gauss-Bonnet theory where a complex vector field non-minimally couples with Gauss-Bonnet invariant. For this purpose, we expand metric functions and radial functions of a vector field around the event horizon, and substitute the expansions into equations of motion. Demanding that the equations of motion are satisfied in each order, we show that the complex vector field vanishes on the event horizon. Moreover, when the event horizon is degenerated, it is also implied that the complex vector field vanishes on and outside the horizon.


title: Asymptotically Unbiased Instance-wise Regularized Partial AUC Optimization: Theory and Algorithm

abstract: The Partial Area Under the ROC Curve (PAUC), typically including One-way Partial AUC (OPAUC) and Two-way Partial AUC (TPAUC), measures the average performance of a binary classifier within a specific false positive rate and/or true positive rate interval, which is a widely adopted measure when decision constraints must be considered. Consequently, PAUC optimization has naturally attracted increasing attention in the machine learning community within the last few years. Nonetheless, most of the existing methods could only optimize PAUC approximately, leading to inevitable biases that are not controllable. Fortunately, a recent work presents an unbiased formulation of the PAUC optimization problem via distributional robust optimization. However, it is based on the pair-wise formulation of AUC, which suffers from the limited scalability w.r.t. sample size and a slow convergence rate, especially for TPAUC. To address this issue, we present a simpler reformulation of the problem in an asymptotically unbiased and instance-wise manner. For both OPAUC and TPAUC, we come to a nonconvex strongly concave minimax regularized problem of instance-wise functions. On top of this, we employ an efficient solver enjoys a linear per-iteration computational complexity w.r.t. the sample size and a time-complexity of $O(\epsilon^{-1/3})$ to reach a $\epsilon$ stationary point. Furthermore, we find that the minimax reformulation also facilitates the theoretical analysis of generalization error as a byproduct. Compared with the existing results, we present new error bounds that are much easier to prove and could deal with hypotheses with real-valued outputs. Finally, extensive experiments on several benchmark datasets demonstrate the effectiveness of our method.


title: A Survey on Extreme Multi-label Learning

abstract: Multi-label learning has attracted significant attention from both academic and industry field in recent decades. Although existing multi-label learning algorithms achieved good performance in various tasks, they implicitly assume the size of target label space is not huge, which can be restrictive for real-world scenarios. Moreover, it is infeasible to directly adapt them to extremely large label space because of the compute and memory overhead. Therefore, eXtreme Multi-label Learning (XML) is becoming an important task and many effective approaches are proposed. To fully understand XML, we conduct a survey study in this paper. We first clarify a formal definition for XML from the perspective of supervised learning. Then, based on different model architectures and challenges of the problem, we provide a thorough discussion of the advantages and disadvantages of each category of methods. For the benefit of conducting empirical studies, we collect abundant resources regarding XML, including code implementations, and useful tools. Lastly, we propose possible research directions in XML, such as new evaluation metrics, the tail label problem, and weakly supervised XML.


title: Kernel-based Substructure Exploration for Next POI Recommendation

abstract: Point-of-Interest (POI) recommendation, which benefits from the proliferation of GPS-enabled devices and location-based social networks (LBSNs), plays an increasingly important role in recommender systems. It aims to provide users with the convenience to discover their interested places to visit based on previous visits and current status. Most existing methods usually merely leverage recurrent neural networks (RNNs) to explore sequential influences for recommendation. Despite the effectiveness, these methods not only neglect topological geographical influences among POIs, but also fail to model high-order sequential substructures. To tackle the above issues, we propose a Kernel-Based Graph Neural Network (KBGNN) for next POI recommendation, which combines the characteristics of both geographical and sequential influences in a collaborative way. KBGNN consists of a geographical module and a sequential module. On the one hand, we construct a geographical graph and leverage a message passing neural network to capture the topological geographical influences. On the other hand, we explore high-order sequential substructures in the user-aware sequential graph using a graph kernel neural network to capture user preferences. Finally, a consistency learning framework is introduced to jointly incorporate geographical and sequential information extracted from two separate graphs. In this way, the two modules effectively exchange knowledge to mutually enhance each other. Extensive experiments conducted on two real-world LBSN datasets demonstrate the superior performance of our proposed method over the state-of-the-arts. Our codes are available at https://github.com/Fang6ang/KBGNN.