title: Greykite: Deploying Flexible Forecasting at Scale at LinkedIn

abstract: Forecasts help businesses allocate resources and achieve objectives. At LinkedIn, product owners use forecasts to set business targets, track outlook, and monitor health. Engineers use forecasts to efficiently provision hardware. Developing a forecasting solution to meet these needs requires accurate and interpretable forecasts on diverse time series with sub-hourly to quarterly frequencies. We present Greykite, an open-source Python library for forecasting that has been deployed on over twenty use cases at LinkedIn. Its flagship algorithm, Silverkite, provides interpretable, fast, and highly flexible univariate forecasts that capture effects such as time-varying growth and seasonality, autocorrelation, holidays, and regressors. The library enables self-serve accuracy and trust by facilitating data exploration, model configuration, execution, and interpretation. Our benchmark results show excellent out-of-the-box speed and accuracy on datasets from a variety of domains. Over the past two years, Greykite forecasts have been trusted by Finance, Engineering, and Product teams for resource planning and allocation, target setting and progress tracking, anomaly detection and root cause analysis. We expect Greykite to be useful to forecast practitioners with similar applications who need accurate, interpretable forecasts that capture complex dynamics common to time series related to human activity.


title: QuaDUE-CCM: Interpretable Distributional Reinforcement Learning using Uncertain Contraction Metrics for Precise Quadrotor Trajectory Tracking

abstract: Accuracy and stability are common requirements for Quadrotor trajectory tracking systems. Designing an accurate and stable tracking controller remains challenging, particularly in unknown and dynamic environments with complex aerodynamic disturbances. We propose a Quantile-approximation-based Distributional-reinforced Uncertainty Estimator (QuaDUE) to accurately identify the effects of aerodynamic disturbances, i.e., the uncertainties between the true and estimated Control Contraction Metrics (CCMs). Taking inspiration from contraction theory and integrating the QuaDUE for uncertainties, our novel CCM-based trajectory tracking framework tracks any feasible reference trajectory precisely whilst guaranteeing exponential convergence. More importantly, the convergence and training acceleration of the distributional RL are guaranteed and analyzed, respectively, from theoretical perspectives. We also demonstrate our system under unknown and diverse aerodynamic forces. Under large aerodynamic forces (>2m/s^2), compared with the classic data-driven approach, our QuaDUE-CCM achieves at least a 56.6% improvement in tracking error. Compared with QuaDRED-MPC, a distributional RL-based approach, QuaDUE-CCM achieves at least a 3 times improvement in contraction rate.


title: BCRLSP: An Offline Reinforcement Learning Framework for Sequential Targeted Promotion

abstract: We utilize an offline reinforcement learning (RL) model for sequential targeted promotion in the presence of budget constraints in a real-world business environment. In our application, the mobile app aims to boost customer retention by sending cash bonuses to customers and control the costs of such cash bonuses during each time period. To achieve the multi-task goal, we propose the Budget Constrained Reinforcement Learning for Sequential Promotion (BCRLSP) framework to determine the value of cash bonuses to be sent to users. We first find out the target policy and the associated Q-values that maximizes the user retention rate using an RL model. A linear programming (LP) model is then added to satisfy the constraints of promotion costs. We solve the LP problem by maximizing the Q-values of actions learned from the RL model given the budget constraints. During deployment, we combine the offline RL model with the LP model to generate a robust policy under the budget constraints. Using both online and offline experiments, we demonstrate the efficacy of our approach by showing that BCRLSP achieves a higher long-term customer retention rate and a lower cost than various baselines. Taking advantage of the near real-time cost control method, the proposed framework can easily adapt to data with a noisy behavioral policy and/or meet flexible budget constraints.


title: Associative Memory Based Experience Replay for Deep Reinforcement Learning

abstract: Experience replay is an essential component in deep reinforcement learning (DRL), which stores the experiences and generates experiences for the agent to learn in real time. Recently, prioritized experience replay (PER) has been proven to be powerful and widely deployed in DRL agents. However, implementing PER on traditional CPU or GPU architectures incurs significant latency overhead due to its frequent and irregular memory accesses. This paper proposes a hardware-software co-design approach to design an associative memory (AM) based PER, AMPER, with an AM-friendly priority sampling operation. AMPER replaces the widely-used time-costly tree-traversal-based priority sampling in PER while preserving the learning performance. Further, we design an in-memory computing hardware architecture based on AM to support AMPER by leveraging parallel in-memory search operations. AMPER shows comparable learning performance while achieving 55x to 270x latency improvement when running on the proposed hardware compared to the state-of-the-art PER running on GPU.


title: Hulls of special typed linear codes and constructions of new EAQECCs

abstract: In this paper, we study Euclidean and Hermitian hulls of generalized Reed-Solomon codes and twisted generalized Reed-Solomon codes, as well as the Hermitian hulls of Roth-Lempel typed codes. We present explicit constructions of MDS and AMDS linear codes for which their hull dimensions are well determined. As an application, we provide several classes of entanglement-assisted quantum error correcting codes with new parameters.


title: Towards the Desirable Decision Boundary by Moderate-Margin Adversarial Training

abstract: Adversarial training, as one of the most effective defense methods against adversarial attacks, tends to learn an inclusive decision boundary to increase the robustness of deep learning models. However, due to the large and unnecessary increase in the margin along adversarial directions, adversarial training causes heavy cross-over between natural examples and adversarial examples, which is not conducive to balancing the trade-off between robustness and natural accuracy. In this paper, we propose a novel adversarial training scheme to achieve a better trade-off between robustness and natural accuracy. It aims to learn a moderate-inclusive decision boundary, which means that the margins of natural examples under the decision boundary are moderate. We call this scheme Moderate-Margin Adversarial Training (MMAT), which generates finer-grained adversarial examples to mitigate the cross-over problem. We also take advantage of logits from a teacher model that has been well-trained to guide the learning of our model. Finally, MMAT achieves high natural accuracy and robustness under both black-box and white-box attacks. On SVHN, for example, state-of-the-art robustness and natural accuracy are achieved.


title: Nuclear Modification Factor in Small System Collisions within Perturbative QCD Including Thermal Effects

abstract: In this paper, dedicated to the memory of the late Prof. Jean Cleymans, the nuclear modification factors, $R_{xA}$, are investigated for pion production in small system collisions, measured by PHENIX experiment at RHIC (Relativistic Heavy Ion Collider). The theoretical framework is the transverse momentum $k_T$-factorization formalism for hard processes at small momentum fraction, $x$. Evidence for collective expansion and thermal effects for pions, produced at equilibrium, is studied based on phenomenological parametrization of blast-wave type in the relaxation time approximation. The dependencies on the centrality and on the projectile species are discussed in terms of the behavior of Cronin peak and the suppression of $R_{xA}$ at large transverse momentum, $p_T$. The multiplicity of produced particles, which is sensitive to the soft sector of the spectra, is also included in the present analysis.


title: RCRN: Real-world Character Image Restoration Network via Skeleton Extraction

abstract: Constructing high-quality character image datasets is challenging because real-world images are often affected by image degradation. There are limitations when applying current image restoration methods to such real-world character images, since (i) the categories of noise in character images are different from those in general images; (ii) real-world character images usually contain more complex image degradation, e.g., mixed noise at different noise levels. To address these problems, we propose a real-world character restoration network (RCRN) to effectively restore degraded character images, where character skeleton information and scale-ensemble feature extraction are utilized to obtain better restoration performance. The proposed method consists of a skeleton extractor (SENet) and a character image restorer (CiRNet). SENet aims to preserve the structural consistency of the character and normalize complex noise. Then, CiRNet reconstructs clean images from degraded character images and their skeletons. Due to the lack of benchmarks for real-world character image restoration, we constructed a dataset containing 1,606 character images with real-world degradation to evaluate the validity of the proposed method. The experimental results demonstrate that RCRN outperforms state-of-the-art methods quantitatively and qualitatively.


title: A Flexible Zero-Inflated Poisson-Gamma model with application to microbiome read counts

abstract: In microbiome studies, it is of interest to use a sample from a population of microbes, such as the gut microbiota community, to estimate the population proportion of these taxa. However, due to biases introduced in sampling and preprocessing steps, these observed taxa abundances may not reflect true taxa abundance patterns in the ecosystem. Repeated measures, including longitudinal study designs, may be potential solutions to mitigate the discrepancy between observed abundances and true underlying abundances. Yet, widely observed zero-inflation and over-dispersion issues can distort downstream statistical analyses aiming to associate taxa abundances with covariates of interest. To this end, we propose a Zero-Inflated Poisson Gamma (ZIPG) framework to address the aforementioned challenges. From a perspective of measurement errors, we accommodate the discrepancy between observations and truths by decomposing the mean parameter in Poisson regression into a true abundance level and a multiplicative measurement of sampling variability from the microbial ecosystem. Then, we provide a flexible model by connecting both mean abundance and the variability to different covariates, and build valid statistical inference procedures for both parameter estimation and hypothesis testing. Through comprehensive simulation studies and real data applications, the proposed ZIPG method provides significant insights into distinguished differential variability and abundance.


title: CARBEN: Composite Adversarial Robustness Benchmark

abstract: Prior literature on adversarial attack methods has mainly focused on attacking with and defending against a single threat model, e.g., perturbations bounded in Lp ball. However, multiple threat models can be combined into composite perturbations. One such approach, composite adversarial attack (CAA), not only expands the perturbable space of the image, but also may be overlooked by current modes of robustness evaluation. This paper demonstrates how CAA's attack order affects the resulting image, and provides real-time inferences of different models, which will facilitate users' configuration of the parameters of the attack level and their rapid evaluation of model prediction. A leaderboard to benchmark adversarial robustness against CAA is also introduced.


title: CharFormer: A Glyph Fusion based Attentive Framework for High-precision Character Image Denoising

abstract: Degraded images commonly exist in the general sources of character images, leading to unsatisfactory character recognition results. Existing methods have dedicated efforts to restoring degraded character images. However, the denoising results obtained by these methods do not appear to improve character recognition performance. This is mainly because current methods only focus on pixel-level information and ignore critical features of a character, such as its glyph, resulting in character-glyph damage during the denoising process. In this paper, we introduce a novel generic framework based on glyph fusion and attention mechanisms, i.e., CharFormer, for precisely recovering character images without changing their inherent glyphs. Unlike existing frameworks, CharFormer introduces a parallel target task for capturing additional information and injecting it into the image denoising backbone, which will maintain the consistency of character glyphs during character image denoising. Moreover, we utilize attention-based networks for global-local feature interaction, which will help to deal with blind denoising and enhance denoising performance. We compare CharFormer with state-of-the-art methods on multiple datasets. The experimental results show the superiority of CharFormer quantitatively and qualitatively.


title: Hydrodynamics, viscous electron fluid, and Wiedeman-Franz law in 2D semiconductors

abstract: Considering theoretically the transition between hydrodynamic and ballistic regimes in 2D semiconductors, we show that electrons in high-mobility 2D GaAs are by far the best system for the direct observation of collective hydrodynamic effects even in bulk transport properties independent of complicated transport features in narrow constrictions and small systems where Gurzhi phenomena are typically studied experimentally. We predict a strong hydrodynamics-induced generic violation of the Wiedeman-Franz law in bulk 2D GaAs systems for mobilities as modest as $10^6 \mathrm{cm}^2/Vs$ and densities $1$-$5\times10^{11} \mathrm{cm}^{-2}$ in the temperature range of $T=1$-$40K$.


title: On the size of finite Sidon sets

abstract: A Sidon set is a set of integers containing no nontrivial solutions to the equation $a+b=c+d$. We improve on the lower bound on the diameter of a Sidon set with $k$ elements: if $k$ is sufficiently large and ${\cal A}$ is a Sidon set with $k$ elements, then $diam({\cal A})\ge k^2-1.99405 k^{3/2}$. Alternatively, if $n$ is sufficiently large, then the largest subset of $\{1,2,\dots,n\}$ that is a Sidon set has cardinality at most $n^{1/2}+0.99703 n^{1/4}$. While these are only slight numerical improvements on Balogh-F\"uredi-Roy (arXiv:2103:15850v2), we use a method that is logically simpler.


title: Statistically Characterising Robustness and Fidelity of Quantum Controls and Quantum Control Algorithms

abstract: Robustness of quantum operations or controls is important to build reliable quantum devices. The robustness-infidelity measure (RIM$_p$) is introduced to statistically quantify the robustness and fidelity of a controller as the p-order Wasserstein distance between the fidelity distribution of the controller under any uncertainty and an ideal fidelity distribution. The RIM$_p$ is the p-th root of the p-th raw moment of the infidelity distribution. Using a metrization argument, we justify why RIM$_1$ (the average infidelity) suffices as a practical robustness measure. Based on the RIM$_p$, an algorithmic robustness-infidelity measure (ARIM) is developed to quantify the expected robustness and fidelity of controllers found by a control algorithm. The utility of the RIM and ARIM is demonstrated by considering the problem of robust control of spin-$\tfrac{1}{2}$ networks using energy landscape shaping subject to Hamiltonian uncertainty. The robustness and fidelity of individual control solutions as well as the expected robustness and fidelity of controllers found by different popular quantum control algorithms are characterized. For algorithm comparisons, stochastic and non-stochastic optimization objectives are considered, with the goal of effective RIM optimization in the latter. Although high fidelity and robustness are often conflicting objectives, some high fidelity, robust controllers can usually be found, irrespective of the choice of the quantum control algorithm. However, for noisy optimization objectives, adaptive sequential decision making approaches such as reinforcement learning have a cost advantage compared to standard control algorithms and, in contrast, the infidelities obtained are more consistent with higher RIM values for low noise levels.


title: Learning Granularity-Unified Representations for Text-to-Image Person Re-identification

abstract: Text-to-image person re-identification (ReID) aims to search for pedestrian images of an interested identity via textual descriptions. It is challenging due to both rich intra-modal variations and significant inter-modal gaps. Existing works usually ignore the difference in feature granularity between the two modalities, i.e., the visual features are usually fine-grained while textual features are coarse, which is mainly responsible for the large inter-modal gaps. In this paper, we propose an end-to-end framework based on transformers to learn granularity-unified representations for both modalities, denoted as LGUR. LGUR framework contains two modules: a Dictionary-based Granularity Alignment (DGA) module and a Prototype-based Granularity Unification (PGU) module. In DGA, in order to align the granularities of two modalities, we introduce a Multi-modality Shared Dictionary (MSD) to reconstruct both visual and textual features. Besides, DGA has two important factors, i.e., the cross-modality guidance and the foreground-centric reconstruction, to facilitate the optimization of MSD. In PGU, we adopt a set of shared and learnable prototypes as the queries to extract diverse and semantically aligned features for both modalities in the granularity-unified feature space, which further promotes the ReID performance. Comprehensive experiments show that our LGUR consistently outperforms state-of-the-arts by large margins on both CUHK-PEDES and ICFG-PEDES datasets. Code will be released at https://github.com/ZhiyinShao-H/LGUR.


title: Masked Spatial-Spectral Autoencoders Are Excellent Hyperspectral Defenders

abstract: Deep learning methodology contributes a lot to the development of hyperspectral image (HSI) analysis community. However, it also makes HSI analysis systems vulnerable to adversarial attacks. To this end, we propose a masked spatial-spectral autoencoder (MSSA) in this paper under self-supervised learning theory, for enhancing the robustness of HSI analysis systems. First, a masked sequence attention learning module is conducted to promote the inherent robustness of HSI analysis systems along spectral channel. Then, we develop a graph convolutional network with learnable graph structure to establish global pixel-wise combinations.In this way, the attack effect would be dispersed by all the related pixels among each combination, and a better defense performance is achievable in spatial aspect.Finally, to improve the defense transferability and address the problem of limited labelled samples, MSSA employs spectra reconstruction as a pretext task and fits the datasets in a self-supervised manner.Comprehensive experiments over three benchmarks verify the effectiveness of MSSA in comparison with the state-of-the-art hyperspectral classification methods and representative adversarial defense strategies.


title: On Gauss factorials and their connection to the cyclotomic $\lambda$-invariants of imaginary quadratic fields

abstract: In this paper we establish a connection between the Gauss factorials and Iwasawa's cyclotomic $\lambda$-invariant for an imaginary quadratic field $K$. As a result, we will explain a corespondance between the 1-exceptional primes of Cosgrave and Dilcher for $m = 3$ and $m = 4$, and the primes for which the $\lambda$-invariants for $K = \mathbb{Q}(\sqrt{-3})$ and $K = \mathbb{Q}(i)$ is greater than one, respectively. We refer to the latter primes as ``non-trivial'' for their respective fields. We will also see that similar correspondences are true for $K = \mathbb{Q}(\sqrt{-d})$ when $d = 2,5$ and $6$. As a corollary we find that primes $p$ of the form $p^2 = 3x^2 + 3x + 1$ are always non-trivial for $K = \mathbb{Q}(\sqrt{-3})$. Last, we show that the non-trivial primes $p$ for $K = \mathbb{Q}(i)$ and $K = \mathbb{Q}(\sqrt{-3})$ are characterized by modulo $p^2$ congruences involving Euler and Glaisher numbers respectively.


title: Low-Energy Electron-Track Imaging for a Liquid Argon Time-Projection-Chamber Telescope Concept using Probabilistic Deep Learning

abstract: The GammaTPC is an MeV-scale single-phase liquid argon time-projection-chamber gamma-ray telescope concept with a novel dual-scale pixel-based charge-readout system. It promises to enable a significant improvement in sensitivity to MeV-scale gamma-rays over previous telescopes. The novel pixel-based charge readout allows for imaging of the tracks of electrons scattered by Compton interactions of incident gamma-rays. The two primary contributors to the accuracy of a Compton telescope in reconstructing an incident gamma-ray's original direction are its energy and position resolution. In this work, we focus on using deep learning to optimize the reconstruction of the initial position and direction of electrons scattered in Compton interactions, including using probabilistic models to estimate predictive uncertainty. We show that the deep learning models are able to predict locations of Compton scatters of MeV-scale gamma-rays from simulated pixel-based data to better than 0.6 mm RMS error, and are sensitive to the initial direction of the scattered electron. We compare and contrast different deep learning uncertainty estimation algorithms for reconstruction applications. Additionally, we show that event-by-event estimates of the uncertainty of the locations of the Compton scatters can be used to select those events that were reconstructed most accurately, leading to improvement in locating the origin of gamma-ray sources on the sky.


title: CHARM: A Hierarchical Deep Learning Model for Classification of Complex Human Activities Using Motion Sensors

abstract: In this paper, we report a hierarchical deep learning model for classification of complex human activities using motion sensors. In contrast to traditional Human Activity Recognition (HAR) models used for event-based activity recognition, such as step counting, fall detection, and gesture identification, this new deep learning model, which we refer to as CHARM (Complex Human Activity Recognition Model), is aimed for recognition of high-level human activities that are composed of multiple different low-level activities in a non-deterministic sequence, such as meal preparation, house chores, and daily routines. CHARM not only quantitatively outperforms state-of-the-art supervised learning approaches for high-level activity recognition in terms of average accuracy and F1 scores, but also automatically learns to recognize low-level activities, such as manipulation gestures and locomotion modes, without any explicit labels for such activities. This opens new avenues for Human-Machine Interaction (HMI) modalities using wearable sensors, where the user can choose to associate an automated task with a high-level activity, such as controlling home automation (e.g., robotic vacuum cleaners, lights, and thermostats) or presenting contextually relevant information at the right time (e.g., reminders, status updates, and weather/news reports). In addition, the ability to learn low-level user activities when trained using only high-level activity labels may pave the way to semi-supervised learning of HAR tasks that are inherently difficult to label.


title: Asymptotic stability of depths of localizations of modules

abstract: Let R be a commutative noetherian ring, I an ideal of R, and M a finitely generated R-module. The asymptotic behavior of the quotient modules M/I^n M of M is an actively studied subject in commutative algebra. The main result of this paper asserts that the depth of the localization of M/I^n M at any prime ideal of R is stable for large integers n that do not depend on the prime ideal, if the module M or M/I^n M is Cohen-Macaulay for some n>0, or the ring R is one of the following: a homomorphic image of a Cohen-Macaulay ring, a semi-local ring, an excellent ring, a quasi-excellent and catenary ring, and an acceptable ring.


title: A Note on the Krein-Rutman Theorem for Sectorial Operators

abstract: In this note we present some generalized versions of the Krein-Rutman theorem for sectorial operators. They are formulated in a fashion that can be easily applied to elliptic operators. Another feature of these generalized versions is that they contain some information on the generalized eigenspaces associated with non-principal eigenvalues, which are helpful in the study of the dynamics of evolution equations in ordered Banach spaces.


title: Curve Simplification and Clustering under Fr\'echet Distance

abstract: We present new approximation results on curve simplification and clustering under Fr\'echet distance. Let $T = \{\tau_i : i \in [n] \}$ be polygonal curves in $R^d$ of $m$ vertices each. Let $l$ be any integer from $[m]$. We study a generalized curve simplification problem: given error bounds $\delta_i > 0$ for $i \in [n]$, find a curve $\sigma$ of at most $l$ vertices such that $d_F(\sigma,\tau_i) \le \delta_i$ for $i \in [n]$. We present an algorithm that returns a null output or a curve $\sigma$ of at most $l$ vertices such that $d_F(\sigma,\tau_i) \le \delta_i + \epsilon\delta_{\max}$ for $i \in [n]$, where $\delta_{\max} = \max_{i \in [n]} \delta_i$. If the output is null, there is no curve of at most $l$ vertices within a Fr\'echet distance of $\delta_i$ from $\tau_i$ for $i \in [n]$. The running time is $\tilde{O}\bigl(n^{O(l)} m^{O(l^2)} (dl/\epsilon)^{O(dl)}\bigr)$. This algorithm yields the first polynomial-time bicriteria approximation scheme to simplify a curve $\tau$ to another curve $\sigma$, where the vertices of $\sigma$ can be anywhere in $R^d$, so that $d_F(\sigma,\tau) \le (1+\epsilon)\delta$ and $|\sigma| \le (1+\alpha) \min\{|c| : d_F(c,\tau) \le \delta\}$ for any given $\delta > 0$ and any fixed $\alpha, \epsilon \in (0,1)$. The running time is $\tilde{O}\bigl(m^{O(1/\alpha)} (d/(\alpha\epsilon))^{O(d/\alpha)}\bigr)$. By combining our technique with some previous results in the literature, we obtain an approximation algorithm for $(k,l)$-median clustering. Given $T$, it computes a set $\Sigma$ of $k$ curves, each of $l$ vertices, such that $\sum_{i \in [n]} \min_{\sigma \in \Sigma} d_F(\sigma,\tau_i)$ is within a factor $1+\epsilon$ of the optimum with probability at least $1-\mu$ for any given $\mu, \epsilon \in (0,1)$. The running time is $\tilde{O}\bigl(n m^{O(kl^2)} \mu^{-O(kl)} (dkl/\epsilon)^{O((dkl/\epsilon)\log(1/\mu))}\bigr)$.


title: Interatomic force from neural network based variational quantum Monte Carlo

abstract: Accurate ab initio calculations are of fundamental importance in physics, chemistry, biology, and materials science, which have witnessed rapid development in the last couple of years with the help of machine learning computational techniques such as neural networks. Most of the recent efforts applying neural networks to ab initio calculation have been focusing on the energy of the system. In this study, we take a step forward and look at the interatomic force obtained with neural network wavefunction methods by implementing and testing several commonly used force estimators in variational quantum Monte Carlo (VMC). Our results show that neural network ansatz can improve the calculation of interatomic force upon traditional VMC. The relation between the force error and the quality of neural network, the contribution of different force terms, and the computational cost of each term are also discussed to provide guidelines for future applications. Our work demonstrates that it is promising to apply neural network wavefunction methods in simulating structures/dynamics of molecules/materials and provide training data for developing accurate force fields.


title: Model order reduction for parameterized electromagnetic problems using matrix decomposition and deep neural networks

abstract: A non-intrusive model order reduction (MOR) method for solving parameterized electromagnetic scattering problems is proposed in this paper. A database collecting snapshots of high-fidelity solutions is built by solving the parameterized time-domain Maxwell equations for some values of the material parameters using a fullwave solver based on a high order discontinuous Galerkin time-domain (DGTD) method. To perform a prior dimensionality reduction, a set of reduced basis (RB) functions are extracted from the database via a two-step proper orthogonal decomposition (POD) method. Projection coefficients of the reduced basis functions are further compressed through a convolutional autoencoder (CAE) network. Singular value decomposition (SVD) is then used to extract the principal components of the reduced-order matrices generated by CAE, and a cubic spline interpolation-based (CSI) approach is employed for approximating the dominating time- and parameter-modes of the reduced-order matrices. The generation of the reduced basis and the training of the CAE and CSI are accomplished in the offline stage, thus the RB solution for given time/parameter values can be quickly recovered via outputs of the interpolation model and decoder network. In particular, the offline and online stages of the proposed RB method are completely decoupled, which ensures the validity of the method. The performance of the proposed CAE-CSI ROM is illustrated with numerical experiments for scattering of a plane wave by a 2-D dielectric disk and a multi-layer heterogeneous medium.


title: A Survey on Collaborative DNN Inference for Edge Intelligence

abstract: With the vigorous development of artificial intelligence (AI), the intelligent applications based on deep neural network (DNN) change people's lifestyles and the production efficiency. However, the huge amount of computation and data generated from the network edge becomes the major bottleneck, and traditional cloud-based computing mode has been unable to meet the requirements of real-time processing tasks. To solve the above problems, by embedding AI model training and inference capabilities into the network edge, edge intelligence (EI) becomes a cutting-edge direction in the field of AI. Furthermore, collaborative DNN inference among the cloud, edge, and end device provides a promising way to boost the EI. Nevertheless, at present, EI oriented collaborative DNN inference is still in its early stage, lacking a systematic classification and discussion of existing research efforts. Thus motivated, we have made a comprehensive investigation on the recent studies about EI oriented collaborative DNN inference. In this paper, we firstly review the background and motivation of EI. Then, we classify four typical collaborative DNN inference paradigms for EI, and analyze the characteristics and key technologies of them. Finally, we summarize the current challenges of collaborative DNN inference, discuss the future development trend and provide the future research direction.


title: Autonomously Untangling Long Cables

abstract: Cables are ubiquitous in many settings and it is often useful to untangle them. However, cables are prone to self-occlusions and knots, making them difficult to perceive and manipulate. The challenge increases with cable length: long cables require more complex slack management to facilitate observability and reachability. In this paper, we focus on autonomously untangling cables up to 3 meters in length using a bilateral robot. We develop RGBD perception and motion primitives to efficiently untangle long cables and novel gripper jaws specialized for this task. We present Sliding and Grasping for Tangle Manipulation (SGTM), an algorithm that composes these primitives to iteratively untangle cables with success rates of 67% on isolated overhand and figure-eight knots and 50% on more complex configurations. Supplementary material, visualizations, and videos can be found at https://sites.google.com/view/rss-2022-untangling/home.


title: Spatial point process via regularisation modelling of ambulance call risk

abstract: This study investigates the spatial distribution of emergency alarm call events to identify spatial covariates associated with the events and discern hotspot regions for the events. The study is motivated by the problem of developing optimal dispatching strategies for prehospital resources such as ambulances. To achieve our goals, we model the spatially varying call occurrence risk as an intensity function of an inhomogeneous spatial Poisson process that we assume is a log-linear function of some underlying spatial covariates. The spatial covariates used in this study are related to road network coverage, population density, and the socio-economic status of the population in Skellefte{\aa}, Sweden. A new heuristic algorithm has been developed to select an optimal estimate of the kernel bandwidth in order to obtain the non-parametric intensity estimate of the events and to generate other covariates. Since we consider a large number of spatial covariates as well as their products, and since some of them may be strongly correlated, lasso-like elastic-net regularisation has been used in the log-likelihood intensity modeling to perform variable selection and reduce variance inflation from overfitting and bias from underfitting. As a result of the variable selection, the fitted model structure contains individual covariates of both road network and demographic types. We discovered that hotspot regions of calls have been observed along dense parts of the road network. Evaluation of the model also suggests that the estimated model is stable and can be used to generate a reliable intensity estimate over the region, which can be used as an input in the problem of designing prehospital resource dispatching strategies.


title: Self-calibrating Photometric Stereo by Neural Inverse Rendering

abstract: This paper tackles the task of uncalibrated photometric stereo for 3D object reconstruction, where both the object shape, object reflectance, and lighting directions are unknown. This is an extremely difficult task, and the challenge is further compounded with the existence of the well-known generalized bas-relief (GBR) ambiguity in photometric stereo. Previous methods to resolve this ambiguity either rely on an overly simplified reflectance model, or assume special light distribution. We propose a new method that jointly optimizes object shape, light directions, and light intensities, all under general surfaces and lights assumptions. The specularities are used explicitly to solve uncalibrated photometric stereo via a neural inverse rendering process. We gradually fit specularities from shiny to rough using novel progressive specular bases. Our method leverages a physically based rendering equation by minimizing the reconstruction error on a per-object-basis. Our method demonstrates state-of-the-art accuracy in light estimation and shape recovery on real-world datasets.


title: Sotto Voce: Federated Speech Recognition with Differential Privacy Guarantees

abstract: Speech data is expensive to collect, and incredibly sensitive to its sources. It is often the case that organizations independently collect small datasets for their own use, but often these are not performant for the demands of machine learning. Organizations could pool these datasets together and jointly build a strong ASR system; sharing data in the clear, however, comes with tremendous risk, in terms of intellectual property loss as well as loss of privacy of the individuals who exist in the dataset. In this paper, we offer a potential solution for learning an ML model across multiple organizations where we can provide mathematical guarantees limiting privacy loss. We use a Federated Learning approach built on a strong foundation of Differential Privacy techniques. We apply these to a senone classification prototype and demonstrate that the model improves with the addition of private data while still respecting privacy.


title: On Scheduling Ring-All-Reduce Learning Jobs in Multi-Tenant GPU Clusters with Communication Contention

abstract: Powered by advances in deep learning (DL) techniques, machine learning and artificial intelligence have achieved astonishing successes. However, the rapidly growing needs for DL also led to communication- and resource-intensive distributed training jobs for large-scale DL training, which are typically deployed over GPU clusters. To sustain the ever-increasing demand for DL training, the so-called "ring-all-reduce" (RAR) technologies have recently emerged as a favorable computing architecture to efficiently process network communication and computation load in GPU clusters. The most salient feature of RAR is that it removes the need for dedicated parameter servers, thus alleviating the potential communication bottleneck. However, when multiple RAR-based DL training jobs are deployed over GPU clusters, communication bottlenecks could still occur due to contentions between DL training jobs. So far, there remains a lack of theoretical understanding on how to design contention-aware resource scheduling algorithms for RAR-based DL training jobs, which motivates us to fill this gap in this work. Our main contributions are three-fold: i) We develop a new analytical model that characterizes both communication overhead related to the worker distribution of the job and communication contention related to the co-location of different jobs; ii) Based on the proposed analytical model, we formulate the problem as a non-convex integer program to minimize the makespan of all RAR-based DL training jobs. To address the unique structure in this problem that is not amenable for optimization algorithm design, we reformulate the problem into an integer linear program that enables provable approximation algorithm design called SJF-BCO (Smallest Job First with Balanced Contention and Overhead); and iii) We conduct extensive experiments to show the superiority of SJF-BCO over existing schedulers.


title: Bagging Regional Classification Activation Maps for Weakly Supervised Object Localization

abstract: Classification activation map (CAM), utilizing the classification structure to generate pixel-wise localization maps, is a crucial mechanism for weakly supervised object localization (WSOL). However, CAM directly uses the classifier trained on image-level features to locate objects, making it prefers to discern global discriminative factors rather than regional object cues. Thus only the discriminative locations are activated when feeding pixel-level features into this classifier. To solve this issue, this paper elaborates a plug-and-play mechanism called BagCAMs to better project a well-trained classifier for the localization task without refining or re-training the baseline structure. Our BagCAMs adopts a proposed regional localizer generation (RLG) strategy to define a set of regional localizers and then derive them from a well-trained classifier. These regional localizers can be viewed as the base learner that only discerns region-wise object factors for localization tasks, and their results can be effectively weighted by our BagCAMs to form the final localization map. Experiments indicate that adopting our proposed BagCAMs can improve the performance of baseline WSOL methods to a great extent and obtains state-of-the-art performance on three WSOL benchmarks. Code are released at https://github.com/zh460045050/BagCAMs.


title: Experimental verification of polar structures in ultrathin BaTiO_{3} layers using resonant x-ray reflectivity

abstract: Functional devices with ultrathin ferroelectric layers have been attracted as a promising candidate for next-generation memory and logic device applications. Using the ultrathin ferroelectric layers, particularly approaching the two-dimensional limit, however, it is still challenging to control ferroelectric switching and to observe ferroelectricity by spectroscopic tools. In particular, conventional methods such as electrical measurements and piezoelectric response force microscopy are very limited due to leakage currents and the smallness of the ferroelectric signals. Here, we show that the ferroelectricity of ultrathin SrRuO3/BaTiO3/SrRuO3 heterostructures grown on SrTiO3(100) substrates can be measured using resonant x-ray reflectivity (RXRR). This experimental technique can provide an element-specific electronic depth profile as well as increased sensitivity to Ti off-center displacements at the Ti K pre-edge. The depth-sensitivity of RXRR selectively detects the strong polarization dependence of the Ti pre-edge features of ultrathin BaTiO3 layers while discriminating the contribution of the SrTiO3 substrate. This technique verified that the BaTiO3 layer can be ferroelectric down to the lowest experimental limit of a critical thickness of 2.5 unit cells. Our results can open a novel way to explore ultrathin ferroelectric-based nano-electronic devices.


title: On an $L^2$ critical Boltzmann equation

abstract: We prove the existence of a class of large global scattering solutions of Boltzmann's equation with constant collision kernel in two dimensions. These solutions are found for $L^2$ perturbations of an underlying initial data which is Gaussian jointly in space and velocity. Additionally, the perturbation is required to satisfy natural physical constraints for the total mass and second moments, corresponding to conserved or controlled quantities. The space $L^2$ is a scaling critical space for the equation under consideration. If the initial data is Schwartz then the solution is unique and again Schwartz on any bounded time interval.


title: Statistic behaviors of gauge-invariance-dominated 1D chiral current random model

abstract: By considering energy flow, we construct the one-dimensional (1d) model consisting of the quasiparticles caused by asymmetric hopping (in carrier position space) or the complex bosonic potential whose varying gradience with a chiral ordering plays the role of ingredience of quasiparticles. A bosonic potential can be generated and the chaotic dynamics of chiral excitations after disorder average can be investigated in the presence of gauge invariance. This feature is also shared by the well-known non-Hermitian systems.


title: Adaptive Sketches for Robust Regression with Importance Sampling

abstract: We introduce data structures for solving robust regression through stochastic gradient descent (SGD) by sampling gradients with probability proportional to their norm, i.e., importance sampling. Although SGD is widely used for large scale machine learning, it is well-known for possibly experiencing slow convergence rates due to the high variance from uniform sampling. On the other hand, importance sampling can significantly decrease the variance but is usually difficult to implement because computing the sampling probabilities requires additional passes over the data, in which case standard gradient descent (GD) could be used instead. In this paper, we introduce an algorithm that approximately samples $T$ gradients of dimension $d$ from nearly the optimal importance sampling distribution for a robust regression problem over $n$ rows. Thus our algorithm effectively runs $T$ steps of SGD with importance sampling while using sublinear space and just making a single pass over the data. Our techniques also extend to performing importance sampling for second-order optimization.


title: DB-LSH: Locality-Sensitive Hashing with Query-based Dynamic Bucketing

abstract: Among many solutions to the high-dimensional approximate nearest neighbor (ANN) search problem, locality sensitive hashing (LSH) is known for its sub-linear query time and robust theoretical guarantee on query accuracy. Traditional LSH methods can generate a small number of candidates quickly from hash tables but suffer from large index sizes and hash boundary problems. Recent studies to address these issues often incur extra overhead to identify eligible candidates or remove false positives, making query time no longer sub-linear. To address this dilemma, in this paper we propose a novel LSH scheme called DB-LSH which supports efficient ANN search for large high-dimensional datasets. It organizes the projected spaces with multi-dimensional indexes rather than using fixed-width hash buckets. Our approach can significantly reduce the space cost as by avoiding the need to maintain many hash tables for different bucket sizes. During the query phase of DB-LSH, a small number of high-quality candidates can be generated efficiently by dynamically constructing query-based hypercubic buckets with the required widths through index-based window queries. For a dataset of $n$ $d$-dimensional points with approximation ratio $c$, our rigorous theoretical analysis shows that DB-LSH achieves a smaller query cost ${O(n^{\rho^*} d\log n)}$, where ${\rho^*}$ is bounded by ${1/c^{\alpha}}$ while the bound is ${1/c}$ in the existing work. An extensive range of experiments on real-world data demonstrates the superiority of DB-LSH over state-of-the-art methods on both efficiency and accuracy.


title: Distributed Safe Learning and Planning for Multi-robot Systems

abstract: This paper considers the problem of online multi-robot motion planning with general nonlinear dynamics subject to unknown external disturbances. We propose dSLAP, a distributed safe learning and planning framework that allows the robots to safely navigate through the environments by coupling online learning and motion planning. Gaussian process regression is used to online learn the disturbances with uncertainty quantification. The safe motion planning algorithm ensures collision avoidance against the learning uncertainty and utilizes set-valued analysis to achieve fast adaptation in response to the newly learned models. A model predictive control problem is then formulated and solved to return a control policy that balances between actively exploring the unknown disturbances and reaching goal regions. Sufficient conditions are established to guarantee the safety of the robots in the absence of backup policy. Monte Carlo simulations are conducted for evaluation.


title: ChronosPerseus: Randomized Point-based Value Iteration with Importance Sampling for POSMDPs

abstract: In reinforcement learning, agents have successfully used environments modeled with Markov decision processes (MDPs). However, in many problem domains, an agent may suffer from noisy observations or random times until its subsequent decision. While partially observable Markov decision processes (POMDPs) have dealt with noisy observations, they have yet to deal with the unknown time aspect. Of course, one could discretize the time, but this leads to Bellman's Curse of Dimensionality. To incorporate continuous sojourn-time distributions in the agent's decision making, we propose that partially observable semi-Markov decision processes (POSMDPs) can be helpful in this regard. We extend \citet{Spaan2005a} randomized point-based value iteration (PBVI) \textsc{Perseus} algorithm used for POMDP to POSMDP by incorporating continuous sojourn time distributions and using importance sampling to reduce the solver complexity. We call this new PBVI algorithm with importance sampling for POSMDPs -- \textsc{ChronosPerseus}. This further allows for compressed complex POMDPs requiring temporal state information by moving this information into state sojourn time of a POMSDP. The second insight is that keeping a set of sampled times and weighting it by its likelihood can be used in a single backup; this helps further reduce the algorithm complexity. The solver also works on episodic and non-episodic problems. We conclude our paper with two examples, an episodic bus problem and a non-episodic maintenance problem.


title: Cross-Domain Cross-Set Few-Shot Learning via Learning Compact and Aligned Representations

abstract: Few-shot learning (FSL) aims to recognize novel queries with only a few support samples through leveraging prior knowledge from a base dataset. In this paper, we consider the domain shift problem in FSL and aim to address the domain gap between the support set and the query set. Different from previous cross-domain FSL work (CD-FSL) that considers the domain shift between base and novel classes, the new problem, termed cross-domain cross-set FSL (CDSC-FSL), requires few-shot learners not only to adapt to the new domain, but also to be consistent between different domains within each novel class. To this end, we propose a novel approach, namely stabPA, to learn prototypical compact and cross-domain aligned representations, so that the domain shift and few-shot learning can be addressed simultaneously. We evaluate our approach on two new CDCS-FSL benchmarks built from the DomainNet and Office-Home datasets respectively. Remarkably, our approach outperforms multiple elaborated baselines by a large margin, e.g., improving 5-shot accuracy by 6.0 points on average on DomainNet. Code is available at https://github.com/WentaoChen0813/CDCS-FSL


title: CLMFormer: Mitigating Data Redundancy to Revitalize Transformer-based Long-Term Time Series Forecasting System

abstract: Long-term time-series forecasting (LTSF) plays a crucial role in various practical applications. Transformer and its variants have become the de facto backbone for LTSF, offering exceptional capabilities in processing long sequence data. However, existing Transformer-based models, such as Fedformer and Informer, often achieve their best performances on validation sets after just a few epochs, indicating potential underutilization of the Transformer's capacity. One of the reasons that contribute to this overfitting is data redundancy arising from the rolling forecasting settings in the data augmentation process, particularly evident in longer sequences with highly similar adjacent data. In this paper, we propose a novel approach to address this issue by employing curriculum learning and introducing a memory-driven decoder. Specifically, we progressively introduce Bernoulli noise to the training samples, which effectively breaks the high similarity between adjacent data points. To further enhance forecasting accuracy, we introduce a memory-driven decoder. This component enables the model to capture seasonal tendencies and dependencies in the time-series data and leverages temporal relationships to facilitate the forecasting process. The experimental results on six real-life LTSF benchmarks demonstrate that our approach can be seamlessly plugged into varying Transformer-based models, with our approach enhancing the LTSF performances of various Transformer-based models by maximally 30%.


title: Structural Prior Guided Generative Adversarial Transformers for Low-Light Image Enhancement

abstract: We propose an effective Structural Prior guided Generative Adversarial Transformer (SPGAT) to solve low-light image enhancement. Our SPGAT mainly contains a generator with two discriminators and a structural prior estimator (SPE). The generator is based on a U-shaped Transformer which is used to explore non-local information for better clear image restoration. The SPE is used to explore useful structures from images to guide the generator for better structural detail estimation. To generate more realistic images, we develop a new structural prior guided adversarial learning method by building the skip connections between the generator and discriminators so that the discriminators can better discriminate between real and fake features. Finally, we propose a parallel windows-based Swin Transformer block to aggregate different level hierarchical features for high-quality image restoration. Experimental results demonstrate that the proposed SPGAT performs favorably against recent state-of-the-art methods on both synthetic and real-world datasets.


title: Robust AI Driving Strategy for Autonomous Vehicles

abstract: There has been significant progress in sensing, perception, and localization for automated driving, However, due to the wide spectrum of traffic/road structure scenarios and the long tail distribution of human driver behavior, it has remained an open challenge for an intelligent vehicle to always know how to make and execute the best decision on road given available sensing / perception / localization information. In this chapter, we talk about how artificial intelligence and more specifically, reinforcement learning, can take advantage of operational knowledge and safety reflex to make strategical and tactical decisions. We discuss some challenging problems related to the robustness of reinforcement learning solutions and their implications to the practical design of driving strategies for autonomous vehicles. We focus on automated driving on highway and the integration of reinforcement learning, vehicle motion control, and control barrier function, leading to a robust AI driving strategy that can learn and adapt safely.


title: Profit Maximization using Social Networks in Two-Phase Setting

abstract: Now-a-days, \emph{Online Social Networks} have been predominantly used by commercial houses for viral marketing where the goal is to maximize profit. In this paper, we study the problem of Profit Maximization in the two\mbox{-}phase setting. The input to the problem is a \emph{social network} where the users are associated with a cost and benefit value, and a fixed amount of budget splitted into two parts. Here, the cost and the benefit associated with a node signify its incentive demand and the amount of benefit that can be earned by influencing that user, respectively. The goal of this problem is to find out the optimal seed sets for both phases such that the aggregated profit at the end of the diffusion process is maximized. First, we develop a mathematical model based on the \emph{Independent Cascade Model} of diffusion that captures the aggregated profit in an \emph{expected} sense. Subsequently, we show that selecting an optimal seed set for the first phase even considering the optimal seed set for the second phase can be selected efficiently, is an $\textsf{NP}$-Hard Problem. Next, we propose two solution methodologies, namely the \emph{single greedy} and the \emph{double greedy} approach for our problem that works based on marginal gain computation. A detailed analysis of both methodologies has been done to understand their time and space requirements. We perform an extensive set of experiments to demonstrate the effectiveness and efficiency of the proposed approaches with real-world datasets. From the experiments, we observe that the proposed solution approaches lead to more profit compared to the baseline methods and in particular, the double greedy approach leads to up to $5 \%$ improvement compared to its single\mbox{-}phase counterpart.


title: Utility Driven Job Selection Problem on Road Networks

abstract: In this paper, we study the problem of \textsc{Utility Driven Job Selection} on Road Networks for which the inputs are: a road network with the vertices as the set of Point-Of-Interests (Henceforth mentioned as POI) and the edges are road segments joining the POIs, a set of jobs with their originating POI, starting time, duration, and the utility. A worker can earn the utility associated with the job if (s)he performs this. As the jobs are originating at different POIs, the worker has to move from one POI to the other one to take up the job. Some budget is available for this purpose. Any two jobs can be taken up by the worker only if the finishing time of the first job plus traveling time from the POI of the first job to the second one should be less than or equal to the starting time of the second job. We call this constraint as the temporal constraint. The goal of this problem is to choose a subset of the jobs to maximize the earned utility such that the budget and temporal constraints should not be violated. We present two solution approaches with detailed analysis. First one of them works based on finding the locally optimal job at the end of every job and we call this approach as the \emph{Best First Search Approach}. The other approach is based on the Nearest Neighbor Search on road networks. We perform a set of experiments with real\mbox{-}world trajectory datasets to demonstrate the efficiency and effectiveness of the proposed solution approaches. We observe that the proposed approaches lead to more utility compared to baseline methods.


title: Approximation Capabilities of Neural Networks using Morphological Perceptrons and Generalizations

abstract: Standard artificial neural networks (ANNs) use sum-product or multiply-accumulate node operations with a memoryless nonlinear activation. These neural networks are known to have universal function approximation capabilities. Previously proposed morphological perceptrons use max-sum, in place of sum-product, node processing and have promising properties for circuit implementations. In this paper we show that these max-sum ANNs do not have universal approximation capabilities. Furthermore, we consider proposed signed-max-sum and max-star-sum generalizations of morphological ANNs and show that these variants also do not have universal approximation capabilities. We contrast these variations to log-number system (LNS) implementations which also avoid multiplications, but do exhibit universal approximation capabilities.


title: Understanding Influence Maximization via Higher-Order Decomposition

abstract: Given its vast application on online social networks, Influence Maximization (IM) has garnered considerable attention over the last couple of decades. Due to the intricacy of IM, most current research concentrates on estimating the first-order contribution of the nodes to select a seed set, disregarding the higher-order interplay between different seeds. Consequently, the actual influence spread frequently deviates from expectations, and it remains unclear how the seed set quantitatively contributes to this deviation. To address this deficiency, this work dissects the influence exerted on individual seeds and their higher-order interactions utilizing the Sobol index, a variance-based sensitivity analysis. To adapt to IM contexts, seed selection is phrased as binary variables and split into distributions of varying orders. Based on our analysis with various Sobol indices, an IM algorithm dubbed SIM is proposed to improve the performance of current IM algorithms by over-selecting nodes followed by strategic pruning. A case study is carried out to demonstrate that the explanation of the impact effect can dependably identify the key higher-order interactions among seeds. SIM is empirically proved to be superior in effectiveness and competitive in efficiency by experiments on synthetic and real-world graphs.


title: Glitches due to (quasi) neutron-vortex scattering in the superfluid inner crust of a pulsar

abstract: We revisit the mechanism of vortex unpinning caused by the neutron-vortex scattering \cite{prad1} in the inner crust of a pulsar. The strain energy released by the crustquake is assumed to be absorbed in some part of the inner crust and causes pair-breaking quasi-neutron excitations from the existing free neutron superfluid in the bulk of the inner crust. The scattering of these quasi-neutrons with the vortex core normal neutrons unpins a large number of vortices from the thermally affected regions and results in pulsar glitches. We consider the geometry of a cylindrical shell of the affected pinning region to study the implications of the vortex unpinning in the context of pulsar glitches. We find that a pulsar can release about $\sim 10^{11} - 10^{13}$ vortices by this mechanism. These numbers are equivalent to the glitch size of orders $\sim 10^{-11} - 10^{-9}$ for Vela-like pulsars with the characteristic age $\tau \simeq 10^4$ years. We also suggest a possibility of a vortex avalanche triggered by the movement of the unpinned vortices. A rough estimate of the glitch size caused by an avalanche shows an encouraging result.


title: Dynamic Bipedal Maneuvers through Sim-to-Real Reinforcement Learning

abstract: For legged robots to match the athletic capabilities of humans and animals, they must not only produce robust periodic walking and running, but also seamlessly switch between nominal locomotion gaits and more specialized transient maneuvers. Despite recent advancements in controls of bipedal robots, there has been little focus on producing highly dynamic behaviors. Recent work utilizing reinforcement learning to produce policies for control of legged robots have demonstrated success in producing robust walking behaviors. However, these learned policies have difficulty expressing a multitude of different behaviors on a single network. Inspired by conventional optimization-based control techniques for legged robots, this work applies a recurrent policy to execute four-step, 90 degree turns trained using reference data generated from optimized single rigid body model trajectories. We present a novel training framework using epilogue terminal rewards for learning specific behaviors from pre-computed trajectory data and demonstrate a successful transfer to hardware on the bipedal robot Cassie.


title: Envy\mbox{-}free Trip Planning in Group Trip Planning Query Problem

abstract: In recent times, Group Trip Planning Query (henceforth referred to as GTP Query) is one of the well\mbox{-}studied problems in Spatial Databases. The inputs to the problem are a road network where the vertices represent the Point-of-Interests (mentioned as POIs henceforth) and they are grouped into different categories, edges represent the road segments, and edge weight represents the distance and a group of users along with their source and destination location. This problem asks to return one POI from every category such that the aggregated distance traveled by the group is minimized. As the objective is to minimize the aggregated distance, the existing solution methodologies do not consider the individual distances traveled by the group members. To address this issue, we introduce and study the \textsc{Envy Free Group Trip Planning Query} Problem. Along with the inputs of the GTP Query Problem, in this variant, we also have a threshold distance $D$ such that aggregated distance traveled by the group is minimized and for any member pairs the difference between their individual distance traveled is less than equal to $D$. However, it may so happen that a given $D$ value no such set POIs are found. To tackle this issue, we introduce the surrogate problem \textsc{Envy Free Group Trip Planning Query with Minimum Additional Distance} Problem which asks what is the minimum distance to be added with $D$ to obtain at least one solution. For these problems, we design efficient solution approaches and experiment with real-world datasets. From the experiments, we observe that the proposed solution approaches lead to less aggregated distance compared to baseline methods with reasonable computational overhead.


title: Complementary Semi-Deterministic Clusters for Realistic Statistical Channel Models for Positioning

abstract: Positioning benefits from channel models that capture geometric effects and, in particular, from the signal properties of the first arriving path and the spatial consistency of the propagation condition of multiple links. The models that capture the physical effects observed in a realistic deployment scenario are essential for assessing the potential benefits of enhancements in positioning methods. Channel models based on ray-tracing simulations and statistical channel models, which are current state-of-the-art methods employed to evaluate performance of positioning in 3GPP systems, do not fully capture important aspects applicable to positioning. Hence, we propose an extension of existing statistical channel models with semi-deterministic clusters (SDCs). SDCs allow channels to be simulated using three types of clusters: fixed-, specular-, and random-clusters. Our results show that the proposed model aligns with measurements obtained in a real deployment scenario. Thus, our channel models can be used to develop advanced positioning solutions based on machine learning, which enable positioning with centimeter level accuracy in NLOS and multipath scenarios.


title: Towards Realistic Statistical Channel Models For Positioning: Evaluating the Impact of Early Clusters

abstract: Physical effects such as reflection, refraction, and diffraction cause a radio signal to arrive from a transmitter to a receiver in multiple replicas that have different amplitude and rotation. Bandwidth-limited signals, such as positioning reference signals, have a limited time resolution. In reality, the signal is often reflected in the close vicinity of a transmitter and receiver, which causes the displacement of the observed peak from the true peak expected according to the line of sight (LOS) geometry between the transmitter and receiver. In this paper, we show that the existing channel model specified for performance evaluation within 3GPP fails to model the above phenomena. As a result, the simulation results deviate significantly from the measured values. Based on our measurement and simulation results, we propose a model for incorporating the signal reflection by obstacles in the vicinity of transmitter or receiver, so that the outcome of the model corresponds to the measurement made in such scenario.


title: On Non-Negative Quadratic Programming in Geometric Optimization

abstract: We present experimental and theoretical results on a method that applies a numerical solver iteratively to solve several non-negative quadratic programming problems in geometric optimization. The method gains efficiency by exploiting the potential sparsity of the intermediate solutions. We implemented the method to call quadprog of MATLAB iteratively. In comparison with a single call of quadprog, we obtain a 10-fold speedup on two proximity graph problems in $\mathbb{R}^d$ on some public data sets, a 10-fold speedup on the minimum enclosing ball problem on random points in a unit cube in $\mathbb{R}^d$, and a 5-fold speedup on the polytope distance problem on random points from a cube in $\mathbb{R}^d$ when the input size is significantly larger than the dimension; we also obtain a 2-fold or more speedup on deblurring some gray-scale space and thermal images via non-negative least square. We compare with two minimum enclosing ball software by G\"{a}rtner and Fischer et al.; for 1000 nearly cospherical points or random points in a unit cube, the iterative method overtakes the software by G\"{a}rtner at 20 dimensions and the software by Fischer et al. at 170 dimensions. In the image deblurring experiments, the iterative method compares favorably with other software that can solve non-negative least square, including FISTA with backtracking, SBB, FNNLS, and lsqnonneg of MATLAB. We analyze theoretically the number of iterations taken by the iterative scheme to reduce the gap between the current solution value and the optimum by a factor $e$. Under certain assumptions, we prove a bound proportional to the square root of the number of variables.


title: Class-Incremental Lifelong Learning in Multi-Label Classification

abstract: Existing class-incremental lifelong learning studies only the data is with single-label, which limits its adaptation to multi-label data. This paper studies Lifelong Multi-Label (LML) classification, which builds an online class-incremental classifier in a sequential multi-label classification data stream. Training on the data with Partial Labels in LML classification may result in more serious Catastrophic Forgetting in old classes. To solve the problem, the study proposes an Augmented Graph Convolutional Network (AGCN) with a built Augmented Correlation Matrix (ACM) across sequential partial-label tasks. The results of two benchmarks show that the method is effective for LML classification and reducing forgetting.


title: Random 2D nanowire networks: Finite-size effect and the effect of busbar/nanowire contact resistance on their electrical conductivity

abstract: We have studied the resistance of two-dimensional random percolating networks of zero-width metallic nanowires (rings or sticks). We toke into account the nanowire resistance per unit length, the junction (nanowire/nanowire contact) resistance, and the busbar/nanowire contact resistance. Using a mean-field approximation (MFA), we derived the total resistance of the nanoring-based networks as a function of their geometrical and physical parameters. We have proposed a way of accounting for the contribution of the busbar/nanowire contact resistance toward the network resistance. The MFA predictions have been confirmed by our Monte Carlo (MC) numerical simulations. Our study evidenced that the busbar/nanowire contact resistance has a significant effect on the electrical conductivity when the junction resistance dominates over wire resistance.


title: Adaptive t-vMF Dice Loss for Multi-class Medical Image Segmentation

abstract: Dice loss is widely used for medical image segmentation, and many improvement loss functions based on such loss have been proposed. However, further Dice loss improvements are still possible. In this study, we reconsidered the use of Dice loss and discovered that Dice loss can be rewritten in the loss function using the cosine similarity through a simple equation transformation. Using this knowledge, we present a novel t-vMF Dice loss based on the t-vMF similarity instead of the cosine similarity. Based on the t-vMF similarity, our proposed Dice loss is formulated in a more compact similarity loss function than the original Dice loss. Furthermore, we present an effective algorithm that automatically determines the parameter $\kappa$ for the t-vMF similarity using a validation accuracy, called Adaptive t-vMf Dice loss. Using this algorithm, it is possible to apply more compact similarities for easy classes and wider similarities for difficult classes, and we are able to achieve an adaptive training based on the accuracy of the class. Through experiments conducted on four datasets using a five-fold cross validation, we confirmed that the Dice score coefficient (DSC) was further improved in comparison with the original Dice loss and other loss functions.


title: The Diagrammatic Coaction

abstract: The diagrammatic coaction underpins the analytic structure of Feynman integrals, their cuts and the differential equations they admit. The coaction maps any diagram into a tensor product of its pinches and cuts. These correspond respectively to differential forms defining master integrals, and integration contours which place a subset of the propagators on shell. In a canonical basis these forms and contours are dual to each other. In this talk I review our present understanding of this algebraic structure and its manifestation for dimensionally-regularized Feynman integrals that are expandable to polylogarithms around integer dimensions. Using one- and two-loop integral examples, I will explain the duality between forms and contours, and the correspondence between the local coaction acting on the Laurent coefficients in the dimensional regulator and the global coaction acting on generalised hypergeometric functions.


title: Comment on 'Phase transition temperatures of 405-725 K in superfluid ultra-dense hydrogen clusters on metal surfaces' [AIP Advances 6, 045111 (2016)]

abstract: The article in \cite{HolmlidAIPA2016} has recently come to our attention. It makes a number of extraordinary claims that each contradict well established facts in several fields, ranging from atomic and molecular physics to superconductivity and superfluidity, with practically no supporting evidence. We think it worthwhile to rectify the literature with this comment.


title: Tunable piezoelectric metamaterial for Lamb waves using periodic shunted circuits

abstract: Piezoelectric elastic metamaterials offer the ability to overcome the fixed, narrow bandwidth characteristics of passive elastic metamaterials. Interesting ultrasonic band gaps exist in piezoelectric plate metamaterials with periodic electrodes connected to shunted circuits. These band gaps result from an avoided crossing between electrical and mechanical bands, and can arise at lower frequencies than Bloch wave band gaps. Current analytical modeling techniques for these systems are numerically cumbersome, and assume an infinitely periodic plate. We present an approximate two-dimensional analytical model that can be used to directly calculate scattering coefficients for finite length plates. This model is shown to predict a band diagram that compares well with diagrams obtained from finite element analysis (FEA). Lower than 10% difference in the estimation of the location of the band gap was found for a plate thickness of $2$ mm, electrode width of $1$ mm, and gap between electrodes greater than $1.2$ mm. We calculate effective impedances and effective wavenumbers from global scattering coefficients. The calculated effective normalized wavenumber swings from positive values ($0<k_{\mathrm{eff}}\leq 1$) to negative values ($0>k_{\mathrm{eff}}\geq -1$) at the low-frequency band gap, resembling wavenumbers for negative stiffness Helmholtz resonator metamaterials. This presents a new perspective on periodic shunted circuit piezoelectric plates as electrically tunable, negative stiffness metamaterials analogous to Helmholtz resonator lined acoustic waveguides.


title: Learning Near-global-optimal Strategies for Hybrid Non-convex Model Predictive Control of Single Rigid Body Locomotion

abstract: Convex model predictive controls (MPCs) with a single rigid body model have demonstrated strong performance on real legged robots. However, convex MPCs are limited by their assumptions such as small rotation angle and pre-defined gait, limiting the richness of potential solutions. We remove those assumptions and solve the complete mixed-integer non-convex programming with single rigid body model. We first collect datasets of pre-solved problems offline, then learn the problem-solution map to solve this optimization fast for MPC. If warm-starts can be found, offline problems can be solved close to the global optimality. The proposed controller is tested by generating various gaits and behaviors depending on the initial conditions. Hardware test demonstrates online gait generation and adaptation running at more than 50 Hz based on sensor feedback.


title: Solving Graph Laplacians via Multilevel Sparsifiers

abstract: We consider effective preconditioners for solving Laplacians of general weighted graphs. Theoretically, spectral sparsifiers (SSs) provide preconditioners of optimal computational complexity. However, they are not easy to use for real-world applications due to the implementation complications. Multigrid (MG) methods, on the contrary, are computationally efficient but lack of theoretical justifications. To bridge the gap between theory and practice, we adopt ideas of MG and SS methods and proposed preconditioners that can be used in practice with theoretical guarantees. We expand the original graph based on a multilevel structure to obtain an equivalent expanded graph. Although the expanded graph has a low diameter, a favorable property for constructing SSs, it has negatively weighted edges, which is an unfavorable property for the SSs. We design an algorithm to properly eliminate the negatively weighted edges and prove that the resulting expanded graph with positively weighted edges is spectrally equivalent to the expanded graph, thus, the original graph. Due to the low-diameter property of the positively-weighted expanded graph preconditioner (PEGP), existing algorithms for finding SSs can be easily applied. To demonstrate the advantage of working with the PEGP, we propose a type of SS, multilevel sparsifier preconditioner (MSP), that can be constructed in an easy and deterministic manner. We provide some preliminary numerical experiments to verify our theoretical findings and illustrate the practical effectiveness of PEGP and MSP in real-world applications.


title: Optimal consumption under a drawdown constraint over a finite horizon

abstract: This paper studies a finite horizon utility maximization problem on excessive consumption under a drawdown constraint up to the bankruptcy time. Our control problem is an extension of the one considered in Bahman et al. (2019) to the model with a finite horizon and also an extension of the one considered in Jeon and Oh (2022) to the model with zero interest rate. Contrary to Bahman et al. (2019), we encounter a parabolic nonlinear HJB variational inequality with a gradient constraint, in which some time-dependent free boundaries complicate the analysis significantly. Meanwhile, our methodology is built on technical PDE arguments, which differs substantially from the martingale approach in Jeon and Oh (2022). Using dual transform and considering some auxiliary parabolic variational inequalities with both gradient and function constraints, we establish the existence and uniqueness of the classical solution to the HJB variational inequality and characterize all associated free boundaries in analytical form. Consequently, the piecewise optimal feedback controls and some time-dependent thresholds of the wealth variable for different control expressions can be obtained.


title: Long-time asymptotics for a fourth-order dispersive nonlinear Schr\"{o}dinger equation with nonzero boundary conditions

abstract: In this work, we consider the long-time asymptotics for the Cauchy problem of a fourth-order dispersive nonlinear Schr\"{o}dinger equation with nonzero boundary conditions at infinity. Firstly, in order to construct the basic Riemann-Hilbert problem associated with nonzero boundary conditions, we analysis direct scattering problem. Then we deform the corresponding matrix Riemann-Hilbert problem to explicitly solving models via using the nonlinear steepest descent method and employing the $g$-function mechanism to eliminate the exponential growths of the jump matrices. Finally, we obtain the asymptotic stage of modulation instability for the fourth-order dispersive nonlinear Schr\"{o}dinger equation.


title: Reducing Geographic Disparities in Automatic Speech Recognition via Elastic Weight Consolidation

abstract: We present an approach to reduce the performance disparity between geographic regions without degrading performance on the overall user population for ASR. A popular approach is to fine-tune the model with data from regions where the ASR model has a higher word error rate (WER). However, when the ASR model is adapted to get better performance on these high-WER regions, its parameters wander from the previous optimal values, which can lead to worse performance in other regions. In our proposed method, we utilize the elastic weight consolidation (EWC) regularization loss to identify directions in parameters space along which the ASR weights can vary to improve for high-error regions, while still maintaining performance on the speaker population overall. Our results demonstrate that EWC can reduce the word error rate (WER) in the region with highest WER by 3.2% relative while reducing the overall WER by 1.3% relative. We also evaluate the role of language and acoustic models in ASR fairness and propose a clustering algorithm to identify WER disparities based on geographic region.


title: Functoriality of Bose-Mesner algebras and profinite association schemes

abstract: We show that taking the set of primitive idempotents of commutative association schemes is a functor from the category of commutative association schemes with surjective morphisms to the category of finite sets with surjective partial functions. We then consider projective systems of commutative association schemes consisting of surjections (which we call profinite association schemes), for which Bose-Mesner algebra is defined, and describe a Delsarte theory on such schemes. This is another method for generalizing association schemes to those on infinite sets, related with the approach by Barg and Skriganov. Relation with $(t,m,s)$-nets and $(t,s)$-sequences is studied. We reprove some of the results of Martin-Stinson from this viewpoint.


title: TS2-Net: Token Shift and Selection Transformer for Text-Video Retrieval

abstract: Text-Video retrieval is a task of great practical value and has received increasing attention, among which learning spatial-temporal video representation is one of the research hotspots. The video encoders in the state-of-the-art video retrieval models usually directly adopt the pre-trained vision backbones with the network structure fixed, they therefore can not be further improved to produce the fine-grained spatial-temporal video representation. In this paper, we propose Token Shift and Selection Network (TS2-Net), a novel token shift and selection transformer architecture, which dynamically adjusts the token sequence and selects informative tokens in both temporal and spatial dimensions from input video samples. The token shift module temporally shifts the whole token features back-and-forth across adjacent frames, to preserve the complete token representation and capture subtle movements. Then the token selection module selects tokens that contribute most to local spatial semantics. Based on thorough experiments, the proposed TS2-Net achieves state-of-the-art performance on major text-video retrieval benchmarks, including new records on MSRVTT, VATEX, LSMDC, ActivityNet, and DiDeMo.


title: Self-improving properties of very weak solutions to double phase systems

abstract: We prove the self-improving property of very weak solutions to non-uniformly elliptic problems of double phase type in divergence form under sharp assumptions on the nonlinearity.


title: Bunched proton acceleration from a laser-irradiated cone target

abstract: Laser-driven ion acceleration is an attractive technique for compact high-energy ion sources. Currently, among various physical and technical issues to be solved, the boost of ion energy and the reduction of energy spread represent the key challenges with this technique. Here we present a scheme to tackle these challenges by using a hundred-terawatt-class laser pulse irradiating a cone target. Three-dimensional particle-in-cell simulations show that a large number of electrons are dragged out of the cone walls and accelerated to hundreds of MeV by the laser fields inside the cone. When these energetic dense electron beams pass through the cone target tip into vacuum, a very high bunching acceleration field, up to tens of TV/m, quickly forms. Protons are accelerated and simultaneously bunched by this field, resulting in quasi-monoenergetic proton beams with hundred MeV energy and low energy spread of ~2%. Results exploring the scaling of the proton beam energy with laser and target parameters are presented, indicating that the scheme is robust. This opens a new route for compact high-energy proton sources from fundamental research to biomedical applications.


title: Dynamics and Stability under Iterated Sanctions and Counter-sanctions

abstract: In the paper a simple discrete dynamical model for dynamics of two antagonistic agents (opponents) under iterated sanctions and counter-sanctions is proposed. The model is inspired with Osipov-Lanchester model for combats. Simple stability criteria are derived both for the full information case and for stochastic uncertainty case. The results provide some important qualitative conclusions that are interpreted in terms of international stability preservation.


title: Surfaces via spinors and soliton equations

abstract: This article surveys the Weierstrass representation of surfaces in the three- and four-dimensional spaces, with an emphasis on its relation to the Willmore functional. We also describe an application of this representation to constructing a new type of solutions to the Davey-Stewartson II equation. They have regular initial data, gain one-point singularities at certain moments of time, and extend to smooth solutions for the remaining times.


title: Non-parametric Reconstruction Of Some Cosmological Parameters

abstract: The present thesis is devoted to the non-parametric reconstruction of some cosmological parameters using diverse observational datasets. The Universe is assumed to be spatially homogeneous and isotropic, thus described by the FLRW metric. The first chapter provides a brief introduction to cosmology and focuses on the reconstruction methods. An assessment of the cosmic distance-duality relation is discussed in chapter 2. In chapter 3, a non-parametric reconstruction of the cosmological jerk parameter is carried out. Chapter 4 explores the possibility of a non-gravitational interaction in the cosmic dark sector. In chapter 5, attempts are made to revisit a non-parametric reconstruction of the cosmic deceleration parameter using various combinations of recently updated background datasets and the growth rate of structure measurements from the redshift-space distortions. Finally, chapter 6 contains the concluding remarks and relevant discussion regarding the overall work presented in the thesis.


title: The Lottery Ticket Hypothesis for Self-attention in Convolutional Neural Network

abstract: Recently many plug-and-play self-attention modules (SAMs) are proposed to enhance the model generalization by exploiting the internal information of deep convolutional neural networks (CNNs). In general, previous works ignore where to plug in the SAMs since they connect the SAMs individually with each block of the entire CNN backbone for granted, leading to incremental computational cost and the number of parameters with the growth of network depth. However, we empirically find and verify some counterintuitive phenomena that: (a) Connecting the SAMs to all the blocks may not always bring the largest performance boost, and connecting to partial blocks would be even better; (b) Adding the SAMs to a CNN may not always bring a performance boost, and instead it may even harm the performance of the original CNN backbone. Therefore, we articulate and demonstrate the Lottery Ticket Hypothesis for Self-attention Networks: a full self-attention network contains a subnetwork with sparse self-attention connections that can (1) accelerate inference, (2) reduce extra parameter increment, and (3) maintain accuracy. In addition to the empirical evidence, this hypothesis is also supported by our theoretical evidence. Furthermore, we propose a simple yet effective reinforcement-learning-based method to search the ticket, i.e., the connection scheme that satisfies the three above-mentioned conditions. Extensive experiments on widely-used benchmark datasets and popular self-attention networks show the effectiveness of our method. Besides, our experiments illustrate that our searched ticket has the capacity of transferring to some vision tasks, e.g., crowd counting and segmentation.


title: SenseFi: A Library and Benchmark on Deep-Learning-Empowered WiFi Human Sensing

abstract: WiFi sensing has been evolving rapidly in recent years. Empowered by propagation models and deep learning methods, many challenging applications are realized such as WiFi-based human activity recognition and gesture recognition. However, in contrast to deep learning for visual recognition and natural language processing, no sufficiently comprehensive public benchmark exists. In this paper, we review the recent progress on deep learning enabled WiFi sensing, and then propose a benchmark, SenseFi, to study the effectiveness of various deep learning models for WiFi sensing. These advanced models are compared in terms of distinct sensing tasks, WiFi platforms, recognition accuracy, model size, computational complexity, feature transferability, and adaptability of unsupervised learning. It is also regarded as a tutorial for deep learning based WiFi sensing, starting from CSI hardware platform to sensing algorithms. The extensive experiments provide us with experiences in deep model design, learning strategy skills and training techniques for real-world applications. To the best of our knowledge, this is the first benchmark with an open-source library for deep learning in WiFi sensing research. The benchmark codes are available at https://github.com/xyanchen/WiFi-CSI-Sensing-Benchmark.


title: Structure-preserving finite-element schemes for the Euler-Poisson equations

abstract: We discuss structure-preserving numerical discretizations for repulsive and attractive Euler-Poisson equations that find applications in fluid-plasma and self-gravitation modeling. The scheme is fully discrete and structure preserving in the sense that it maintains a discrete energy law, as well as hyperbolic invariant domain properties, such as positivity of the density and a minimum principle of the specific entropy. A detailed discussion of algorithmic details is given, as well as proofs of the claimed properties. We present computational experiments corroborating our analytical findings and demonstrating the computational capabilities of the scheme.


title: TransGrasp: Grasp Pose Estimation of a Category of Objects by Transferring Grasps from Only One Labeled Instance

abstract: Grasp pose estimation is an important issue for robots to interact with the real world. However, most of existing methods require exact 3D object models available beforehand or a large amount of grasp annotations for training. To avoid these problems, we propose TransGrasp, a category-level grasp pose estimation method that predicts grasp poses of a category of objects by labeling only one object instance. Specifically, we perform grasp pose transfer across a category of objects based on their shape correspondences and propose a grasp pose refinement module to further fine-tune grasp pose of grippers so as to ensure successful grasps. Experiments demonstrate the effectiveness of our method on achieving high-quality grasps with the transferred grasp poses. Our code is available at https://github.com/yanjh97/TransGrasp.


title: MAC-DO: An Efficient Output-Stationary GEMM Accelerator for CNNs Using DRAM Technology

abstract: DRAM-based in-situ accelerators have shown their potential in addressing the memory wall challenge of the traditional von Neumann architecture. Such accelerators exploit charge sharing or logic circuits for simple logic operations at the DRAM subarray level. However, their throughput is limited due to low array utilization, as only a few row cells in a DRAM array participate in operations while most rows remain deactivated. Moreover, they require many cycles for more complex operations such as a multi-bit multiply-accumulate (MAC) operation, resulting in significant data access and movement and potentially worsening power efficiency. To overcome these limitations, this paper presents MAC-DO, an efficient and low-power DRAM-based in-situ accelerator. Compared to previous DRAM-based in-situ accelerators, a MAC-DO cell, consisting of two 1T1C DRAM cells (two transistors and two capacitors), innately supports a multi-bit MAC operation within a single cycle, ensuring good linearity and compatibility with existing 1T1C DRAM cells and array structures. This achievement is facilitated by a novel analog computation method utilizing charge steering. Additionally, MAC-DO enables concurrent individual MAC operations in each MAC-DO cell without idle cells, significantly improving throughput and energy efficiency. As a result, a MAC-DO array efficiently can accelerate matrix multiplications based on output stationary mapping, supporting the majority of computations performed in deep neural networks (DNNs). Furthermore, a MAC-DO array efficiently reuses three types of data (input, weight and output), minimizing data movement.


title: Deep Set Classifier for Financial Forensics: An application to detect money laundering

abstract: Financial forensics has an important role in the field of finance to detect and investigate the occurrence of finance related crimes like money laundering. However, as with other forms of criminal activities, the forensics analysis of such activities is a complex undertaking with attempts by the adversaries to constantly upgrade their ability to evade detection. Also, the extent of the volume and complexity of financial activities or transactions further complicates the task of performing financial forensics. Machine Learning or Artificial Intelligence algorithms could be used to deal with such complexities. However, the challenge of limitedly available labeled datasets especially with fraudulent activities limits the means to develop efficient algorithms. Additionally, the complexity of defining precise search patterns of evasive fraudulent transactions further complicates this challenge. In this paper, we developed a novel deep set classifier algorithm based on meta learning and applied it to deal with the complexity deriving patterns of interest with sample of limitedly labelled transactions to detect fraudulent cryptocurrency money laundering transactions. We a unique approach to train our model with progressive provision of samples and the test result exceeds leading research algorithms.


title: What are the Composition and Power of the Jet in Cyg X-1?

abstract: We calculate the electron-positron pair production rate at the base of the jet of Cyg X-1 by collisions of photons from its hot accretion flow using the measurement of its average soft gamma-ray spectra by the Compton Gamma Ray Observatory and INTEGRAL satellites. We have found that this rate approximately equals the flow rate of the leptons emitting the observed synchrotron radio-to-IR spectrum of the jet, calculated using an extended jet model following that of Blandford \& Koenigl. This coincidence shows the jet composition is likely to be pair-dominated. The same coincidences were found before in the microquasar MAXI J1820+070 and in the radio galaxy 3C 120, which shows that the considered mechanism can be universal for at least some classes of relativistic jets. Furthermore, we recalculate the jet power of Cyg X-1. The presence of pairs can strongly reduces the power in the bulk motion of ions, which then limits the parameter space at which the jet can power the $\sim$5-pc nebular structure present in its vicinity.


title: A new perspective on taxicab conic sections

abstract: We explore taxicab conic sections from the perspective of slicing taxicab cones by planes, as opposed to the more well-studied approach from the perspective of distance formulations. After establishing a significant amount of structural framework, a complete characterization of the resulting taxicab conic sections is established, and a number of special cases are explored.


title: Magnetization Switching of Single Magnetite Nanoparticles Monitored Optically

abstract: Magnetic nanomaterials record information as fast as picoseconds in computer memories but retain it for millions of years in ancient rocks. This exceedingly broad range of times is covered by hopping over a potential energy barrier through temperature, ultrafast optical excitation for demagnetization or magnetization manipulation, mechanical stress, or microwaves. As switching depends on nanoparticle size, shape, orientation, and material properties, only single-nanoparticle studies can eliminate ensemble heterogeneity. Here, we push the sensitivity of photothermal magnetic circular dichroism down to individual 20-nm magnetite nanoparticles. Single-particle magnetization curves display superparamagnetic to ferromagnetic behaviors, depending on size, shape, and orientation. Some nanoparticles undergo thermally activated switching on time scales of milliseconds to minutes. Surprisingly, the switching barrier appears to vary in time, leading to dynamical heterogeneity. Our observations will help to identify and eventually control the nanoscale parameters influencing the switching of magnetic nanoparticles, an important step for applications in many fields.


title: Automatic dataset generation for specific object detection

abstract: In the past decade, object detection tasks are defined mostly by large public datasets. However, building object detection datasets is not scalable due to inefficient image collecting and labeling. Furthermore, most labels are still in the form of bounding boxes, which provide much less information than the real human visual system. In this paper, we present a method to synthesize object-in-scene images, which can preserve the objects' detailed features without bringing irrelevant information. In brief, given a set of images containing a target object, our algorithm first trains a model to find an approximate center of the object as an anchor, then makes an outline regression to estimate its boundary, and finally blends the object into a new scene. Our result shows that in the synthesized image, the boundaries of objects blend very well with the background. Experiments also show that SOTA segmentation models work well with our synthesized data.