title: Few-Shot Table-to-Text Generation with Prompt Planning and Knowledge Memorization

abstract: Pre-trained language models (PLM) have achieved remarkable advancement in table-to-text generation tasks. However, the lack of labeled domain-specific knowledge and the topology gap between tabular data and text make it difficult for PLMs to yield faithful text. Low-resource generation likewise faces unique challenges in this domain. Inspired by how humans descript tabular data with prior knowledge, we suggest a new framework: PromptMize, which targets table-to-text generation under few-shot settings. The design of our framework consists of two aspects: a prompt planner and a knowledge adapter. The prompt planner aims to generate a prompt signal that provides instance guidance for PLMs to bridge the topology gap between tabular data and text. Moreover, the knowledge adapter memorizes domain-specific knowledge from the unlabelled corpus to supply essential information during generation. Extensive experiments and analyses are investigated on three open domain few-shot NLG datasets: human, song, and book. Compared with previous state-of-the-art approaches, our model achieves remarkable performance in generating quality as judged by human and automatic evaluations.


title: Bootstrap bounds on D0-brane quantum mechanics

abstract: We derive simple bootstrap bounds on correlation functions of the BFSS matrix theory/D0-brane quantum mechanics. The result strengthens and extends Polchinski's virial theorem bound to finite energies and gives the first non-trivial bound on $\langle{\text{Tr}\, X^2\rangle}$. Despite their simplicity, the bounds hint at some features of the dual black hole geometry. Our best lower bounds are already a factor of $\sim 2$ from existing Monte Carlo results.


title: Dynamic and Stochastic Rational Behavior

abstract: The (static) utility maximization model of Afriat (1967), which is the standard in analysing choice behavior, is under scrutiny. We propose the Dynamic Random Utility Model (DRUM) that is more flexible than the framework of Afriat (1967) and more informative than the static Random Utility Model (RUM) framework of McFadden and Richter (1990). Under DRUM, each decision-maker randomly draws a utility function in each period and maximizes it subject to a menu. DRUM allows for unrestricted time correlation and cross-section heterogeneity in preferences. We characterize DRUM for situations when panel data on choices and menus are available. DRUM is linked to a finite mixture of deterministic behaviors that can be represented as a product of static rationalizable behaviors. This link allows us to convert the characterizations of the static RUM to its dynamic form. In an application, we find that although the static utility maximization model fails to explain population behavior, DRUM can explain it.


title: Learning to Select Pivotal Samples for Meta Re-weighting

abstract: Sample re-weighting strategies provide a promising mechanism to deal with imperfect training data in machine learning, such as noisily labeled or class-imbalanced data. One such strategy involves formulating a bi-level optimization problem called the meta re-weighting problem, whose goal is to optimize performance on a small set of perfect pivotal samples, called meta samples. Many approaches have been proposed to efficiently solve this problem. However, all of them assume that a perfect meta sample set is already provided while we observe that the selections of meta sample set is performance critical. In this paper, we study how to learn to identify such a meta sample set from a large, imperfect training set, that is subsequently cleaned and used to optimize performance in the meta re-weighting setting. We propose a learning framework which reduces the meta samples selection problem to a weighted K-means clustering problem through rigorously theoretical analysis. We propose two clustering methods within our learning framework, Representation-based clustering method (RBC) and Gradient-based clustering method (GBC), for balancing performance and computational efficiency. Empirical studies demonstrate the performance advantage of our methods over various baseline methods.


title: An Investigation into Pre-Training Object-Centric Representations for Reinforcement Learning

abstract: Unsupervised object-centric representation (OCR) learning has recently drawn attention as a new paradigm of visual representation. This is because of its potential of being an effective pre-training technique for various downstream tasks in terms of sample efficiency, systematic generalization, and reasoning. Although image-based reinforcement learning (RL) is one of the most important and thus frequently mentioned such downstream tasks, the benefit in RL has surprisingly not been investigated systematically thus far. Instead, most of the evaluations have focused on rather indirect metrics such as segmentation quality and object property prediction accuracy. In this paper, we investigate the effectiveness of OCR pre-training for image-based reinforcement learning via empirical experiments. For systematic evaluation, we introduce a simple object-centric visual RL benchmark and conduct experiments to answer questions such as ``Does OCR pre-training improve performance on object-centric tasks?'' and ``Can OCR pre-training help with out-of-distribution generalization?''. Our results provide empirical evidence for valuable insights into the effectiveness of OCR pre-training for RL and the potential limitations of its use in certain scenarios. Additionally, this study also examines the critical aspects of incorporating OCR pre-training in RL, including performance in a visually complex environment and the appropriate pooling layer to aggregate the object representations.


title: On a vanishing theorem for birational morphisms of threefolds in positive and mixed characteristics

abstract: We prove a relative Kawamata Viehweg vanishing type theorem for birational morphisms. We use this to prove a Grauert Riemenschneider theorem over log canonical threefolds without zero dimensional log canonical centers, in residue characteristic p greater than five. In large enough residue characteristics, we prove a Grauert Riemenschneider theorem over threefold log canonical singularities with standard coefficients. These vanishing theorems can also be used to study the depth of log canonical singularities at non log canonical centers, as well as the singularities of the log canonical centers themselves. The former simplifies joint work with F. Bernasconi and Z. Patakfalvi, and the latter appears in joint work with Q. Posva.


title: Information Theoretical Importance Sampling Clustering

abstract: A current assumption of most clustering methods is that the training data and future data are taken from the same distribution. However, this assumption may not hold in most real-world scenarios. In this paper, we propose an information theoretical importance sampling based approach for clustering problems (ITISC) which minimizes the worst case of expected distortions under the constraint of distribution deviation. The distribution deviation constraint can be converted to the constraint over a set of weight distributions centered on the uniform distribution derived from importance sampling. The objective of the proposed approach is to minimize the loss under maximum degradation hence the resulting problem is a constrained minimax optimization problem which can be reformulated to an unconstrained problem using the Lagrange method. The optimization problem can be solved by both an alternative optimization algorithm or a general optimization routine by commercially available software. Experiment results on synthetic datasets and a real-world load forecasting problem validate the effectiveness of the proposed model. Furthermore, we show that fuzzy c-means is a special case of ITISC with the logarithmic distortion, and this observation provides an interesting physical interpretation for fuzzy exponent $m$.


title: Latency-aware adaptive shot allocation for run-time efficient variational quantum algorithms

abstract: Efficient classical optimizers are crucial in practical implementations of Variational Quantum Algorithms (VQAs). In particular, to make Stochastic Gradient Descent (SGD) resource efficient, adaptive strategies have been proposed to determine the number of measurement shots used to estimate the gradient. However, existing strategies overlook the overhead that occurs in each iteration. In terms of wall-clock runtime, significant circuit-switching and communication latency can slow the optimization process when using a large number of iterations. In terms of economic cost when using cloud services, per-task prices can become significant. To address these issues, we present an adaptive strategy that balances the number of shots in each iteration to maximize expected gain per unit time or cost by explicitly taking into account the overhead. Our approach can be applied to not only to the simple SGD but also its variants, including Adam. Numerical simulations show that our adaptive shot strategy is actually efficient for Adam, outperforming many existing state-of-the-art adaptive shot optimizers. However, this is not the case for the simple SGD. When focusing on the number of shots as the resource, our adaptive-shots Adam with zero-overhead also outperforms existing optimizers.


title: $0\nu\beta\beta$-decay nuclear matrix elements in self-consistent Skyrme quasiparticle random phase approximation: uncertainty from pairing interaction

abstract: The uncertainty in the nuclear matrix elements (NMEs) of $0\nu\beta\beta$ decay for $^{76}$Ge, $^{82}$Se, $^{128}$Te, $^{130}$Te, and $^{136}$Xe in the self-consistent quasiparticle random phase approximation (QRPA) method is investigated by using eighteen Skyrme interactions supplemented with either a volume- or surface-type of pairing interactions. The NMEs for the isotopes concerned (except $^{136}$Xe) are less sensitive to the particle-hole ($ph$) interactions, while strongly dependent on the employed isovector particle-particle ($pp$) pairing interactions even though the pairing strengths are optimized to the same pairing gap. The results indicate that a precise determination of the isovector $pp$ pairing interaction in the Skyrme energy density functional is of importance to reduce the uncertainty in the NMEs within the QRPA framework.


title: A Transformer-based Response Evaluator for Open-Domain Spoken Conversation

abstract: Many open-domain dialogue systems rely on multiple response generators, any of which can contribute a response to the dialogue in a particular context. Thus the ability to compare potential responses and then select the best plays an important role in ensuring a dialogue system is coherent and engaging. Dialogue coherence goes beyond simply remaining on topic -- some trivia may be on topic and engaging when mentioned out of the blue, but may not be coherent and grounded in the context of the conversation. We carry out experiments on response selection in the Athena system, an Alexa Prize SocialBot that has dedicated content and multiple topic-specific response generators for a large number of topics. First, we collect a corpus of Athena conversations with live human traffic, where potential responses from all enabled response generators are logged and subsequently annotated for response quality. We compare several off-the-shelf response ranking methods for open-domain dialogue to Athena-Heuristic, a heuristic response ranker that was field-tested in Athena during the third Alexa Prize competition. We also compare these to a transformer-based response ranker we call Athena-RR, that we train on our Athena conversations. Athena-RR uses both the conversational context and the dialogue state to rank the potential responses. We find that Athena-RR with a Recall@1 of 70.79\% outperforms Athena-Heuristic and all of the off-the-shelf rankers by a large margin. We then conduct a live A/B study comparing Athena-Heuristic to Athena-RR in a 6,358 conversations with Alexa users. We show that Athena-RR leads to significantly longer conversations that receive significantly higher user ratings than the heuristic rule-based ranker.


title: Extended hard X-ray emission in highly obscured AGN

abstract: Kilo-parsec scale hard ($>$ 3 keV) X-ray continuum and fluorescent Fe K$\alpha$ line emission has been recently discovered in nearby Compton-thick (CT) active galactic nuclei (AGN), which opens new opportunities to improve AGN torus modeling and investigate how the central supermassive black hole interacts with and impacts the host galaxy. Following a pilot Chandra survey of nearby CT AGN, we present in this paper the Chandra spatial analysis results of five uniformly selected non-CT but still heavily obscured AGN to investigate the extended hard X-ray emission by measuring the excess emission counts, excess fractions, and physical scales. Three of them show extended emission in the 3.0-7.0 keV band detected at $>$ 3$\sigma$ above the Chandra PSF with total excess fractions ranging from $\sim$8% - 20%. The extent of the hard emission ranges from at least $\sim$250 pc to 1.1 kpc in radius. We compare these new sources with CT AGN and find that CT AGN appear to be more extended in the hard band than the non-CT AGN. Similar to CT AGN, the amounts of extended hard X-ray emission relative to the total emission of these obscured AGN are not negligible. Together with other extended hard X-ray detected AGN in the literature, we further explore potential correlations between the extended hard X-ray component and AGN parameters. We also discuss the implications for torus modeling and AGN feedback. Considering potential contributions from X-ray binaries (XRBs) to the extended emission, we do not see strong XRB contamination in the overall sample.


title: Gentlest ascent dynamics on manifolds defined by adaptively sampled point-clouds

abstract: Finding saddle points of dynamical systems is an important problem in practical applications such as the study of rare events of molecular systems. Gentlest ascent dynamics (GAD) is one of a number of algorithms in existence that attempt to find saddle points in dynamical systems. It works by deriving a new dynamical system in which saddle points of the original system become stable equilibria. GAD has been recently generalized to the study of dynamical systems on manifolds (differential algebraic equations) described by equality constraints and given in an extrinsic formulation. In this paper, we present an extension of GAD to manifolds defined by point-clouds, formulated using the intrinsic viewpoint. These point-clouds are adaptively sampled during an iterative process that drives the system from the initial conformation (typically in the neighborhood of a stable equilibrium) to a saddle point. Our method requires the reactant (initial conformation), does not require the explicit constraint equations to be specified, and is purely data-driven.


title: Zero-Knowledge Zero-Shot Learning for Novel Visual Category Discovery

abstract: Generalized Zero-Shot Learning (GZSL) and Open-Set Recognition (OSR) are two mainstream settings that greatly extend conventional visual object recognition. However, the limitations of their problem settings are not negligible. The novel categories in GZSL require pre-defined semantic labels, making the problem setting less realistic; the oversimplified unknown class in OSR fails to explore the innate fine-grained and mixed structures of novel categories. In light of this, we are motivated to consider a new problem setting named Zero-Knowledge Zero-Shot Learning (ZK-ZSL) that assumes no prior knowledge of novel classes and aims to classify seen and unseen samples and recover semantic attributes of the fine-grained novel categories for further interpretation. To achieve this, we propose a novel framework that recovers the clustering structures of both seen and unseen categories where the seen class structures are guided by source labels. In addition, a structural alignment loss is designed to aid the semantic learning of unseen categories with their recovered structures. Experimental results demonstrate our method's superior performance in classification and semantic recovery on four benchmark datasets.


title: A complete characterization of sharp thresholds to spherically symmetric multidimensional pressureless Euler-Poisson systems

abstract: The Euler-Poisson system describes the dynamic behavior of many important physical flows including charge transport, plasma with collision and cosmological waves. We prove sharp threshold conditions for the global existence/finite-time-breakdown of solutions to the multidimensional pressureless Euler-Poisson (EP) system with or without background and general initial data. In particular, the initial data could include points where velocity is negative, that is, the flow is directed towards the origin. Obtaining threshold conditions for such systems is extremely hard due to the coupling of various local/nonlocal forces. Remarkably, we are able to achieve a sharp threshold for the zero background case and most importantly, the positive background case, which is quite delicate due to the oscillations present in the solutions. We discover a completely novel nonlinear quantity that helps to analyze the system. In the case of positive background, if the initial data results in a global-in-time solution, then we show that the density is periodic along any single characteristic path. We use the Floquet Theorem to prove periodicity.


title: On the calculation of the ramified Siegel series

abstract: The ramified Siegel series is an important factor that arises in the Fourier coefficient of the Siegel-Eisenstein series. Many results of the formula of the ramified Siegel series under some conditions are already known. However, the explicit formula of the general condition is not calculated. We calculate the formula of the Siegel series where the dimension $n$ is arbitrary, and the additive character $\psi$ is primitive. We calculate when the field $F$ is a non-archimedean non-dyadic local field, including $F=\mathbb{Q}_p$ case. Moreover, we calculate the explicit value of the ramified Siegel series when degree $n$ is 1, 2 and 3.


title: A Comparison of Decision Forest Inference Platforms from A Database Perspective

abstract: Decision forest, including RandomForest, XGBoost, and LightGBM, is one of the most popular machine learning techniques used in many industrial scenarios, such as credit card fraud detection, ranking, and business intelligence. Because the inference process is usually performance-critical, a number of frameworks were developed and dedicated for decision forest inference, such as ONNX, TreeLite from Amazon, TensorFlow Decision Forest from Google, HummingBird from Microsoft, Nvidia FIL, and lleaves. However, these frameworks are all decoupled with data management frameworks. It is unclear whether in-database inference will improve the overall performance. In addition, these frameworks used different algorithms, optimization techniques, and parallelism models. It is unclear how these implementations will affect the overall performance and how to make design decisions for an in-database inference framework. In this work, we investigated the above questions by comprehensively comparing the end-to-end performance of the aforementioned inference frameworks and netsDB, an in-database inference framework we implemented. Through this study, we identified that netsDB is best suited for handling small-scale models on large-scale datasets and all-scale models on small-scale datasets, for which it achieved up to hundreds of times of speedup. In addition, the relation-centric representation we proposed significantly improved netsDB's performance in handling large-scale models, while the model reuse optimization we proposed further improved netsDB's performance in handling small-scale datasets.


title: Directional emission of nanoscale chiral sources modified by gap plasmons

abstract: Efficient manipulation of the emission direction of a chiral nanoscale light source is significant for information transmission and on-chip information processing. Here, we propose a scheme to control the directionality of nanoscale chiral light sources based on gap plasmons. The gap plasmon mode formed by a gold nanorod and a silver nanowire realizes the highly directional emission of chiral light sources. Based on the optical spin-locked light propagation, the hybrid structure enables the directional coupling of chiral emission to achieve a contrast ratio of 99.5%. The emission direction can be manipulated by tailoring the configuration of the structure, such as the positions, aspect ratios, and orientation of the nanorod. Besides, a great local field enhancement exists for highly enhanced emission rates within the nanogap. This chiral nanoscale light source manipulation scheme provides a way for chiral valleytronics and integrated photonics.


title: Active Simultaneously Transmitting and Reflecting (STAR)-RISs: Modelling and Analysis

abstract: A hardware model for active simultaneously transmitting and reflecting reconfigurable intelligent surfaces (STAR-RISs) is proposed consisting of reflection-type amplifiers. The amplitude gains of the STAR element are derived for both coupled and independent phase-shift scenarios. Based on the proposed hardware model, an active STAR-RIS-aided two-user downlink communication system is investigated. Closed-form expressions are obtained for the outage probabilities of both the coupled and independent phase-shift scenarios. To obtain further insights, scaling laws and diversity orders are derived for both users. Analytical results confirm that active STAR-RIS achieves the same diversity orders as passive ones while their scaling laws are different. It is proved that average received SNRs scale with M and M^2 for active and passive STAR-RISs, respectively. Numerical results show that active STAR-RISs outperform passive STAR-RISs in terms of outage probability especially when the number of elements is small.


title: Efficient numerical methods for the Navier-Stokes-Nernst-Planck-Poisson equations

abstract: We propose in this paper efficient first/second-order time-stepping schemes for the evolutional Navier-Stokes-Nernst-Planck-Poisson equations. The proposed schemes are constructed using an auxiliary variable reformulation and sophisticated treatment of the terms coupling different equations. By introducing a dynamic equation for the auxiliary variable and reformulating the original equations into an equivalent system, we construct first- and second-order semi-implicit linearized schemes for the underlying problem. The main advantages of the proposed method are: (1) the schemes are unconditionally stable in the sense that a discrete energy keeps decay during the time stepping; (2) the concentration components of the discrete solution preserve positivity and mass conservation; (3) the delicate implementation shows that the proposed schemes can be very efficiently realized, with computational complexity close to a semi-implicit scheme. Some numerical examples are presented to demonstrate the accuracy and performance of the proposed method. As far as the best we know, this is the first second-order method which satisfies all the above properties for the Navier-Stokes-Nernst-Planck-Poisson equations.


title: Real-Time Visual Feedback to Guide Benchmark Creation: A Human-and-Metric-in-the-Loop Workflow

abstract: Recent research has shown that language models exploit `artifacts' in benchmarks to solve tasks, rather than truly learning them, leading to inflated model performance. In pursuit of creating better benchmarks, we propose VAIDA, a novel benchmark creation paradigm for NLP, that focuses on guiding crowdworkers, an under-explored facet of addressing benchmark idiosyncrasies. VAIDA facilitates sample correction by providing realtime visual feedback and recommendations to improve sample quality. Our approach is domain, model, task, and metric agnostic, and constitutes a paradigm shift for robust, validated, and dynamic benchmark creation via human-and-metric-in-the-loop workflows. We evaluate via expert review and a user study with NASA TLX. We find that VAIDA decreases effort, frustration, mental, and temporal demands of crowdworkers and analysts, simultaneously increasing the performance of both user groups with a 45.8% decrease in the level of artifacts in created samples. As a by product of our user study, we observe that created samples are adversarial across models, leading to decreases of 31.3% (BERT), 22.5% (RoBERTa), 14.98% (GPT-3 fewshot) in performance.


title: Observation of exceptional points and skin effect correspondence in non-Hermitian phononic crystals

abstract: Exceptional points and skin effect, as the two distinct hallmark features unique to the non-Hermitian physics, have each attracted enormous interests. Recent theoretical works reveal that the topologically nontrivial exceptional points can give rise to the non-Hermitian skin effect, which is geometry-dependent. However, this kind of novel correspondence between the exceptional points and skin effect remains to be confirmed by experiments. Here, we corroborate the correspondence in a non-Hermitian phononic crystal. The exceptional points connected by the bulk Fermi arcs, and the skin effects with the geometry dependence, are evidenced in simulations and experiments. Our work, building an experimental bridge between the exceptional points and skin effect and uncovering the unconventional geometry-dependent skin effect, expands a horizon in non-Hermitian physics.


title: RIS-aided Localization under Pixel Failures

abstract: Reconfigurable intelligent surfaces (RISs) hold great potential as one of the key technological enablers for beyond-5G wireless networks, improving localization and communication performance under line-of-sight (LoS) blockage conditions. However, hardware imperfections might cause RIS elements to become faulty, a problem referred to as pixel failures, which can constitute a major showstopper especially for localization. In this paper, we investigate the problem of RIS-aided localization of a user equipment (UE) under LoS blockage in the presence of RIS pixel failures, considering the challenging single-input single-output (SISO) scenario. We first explore the impact of such failures on accuracy through misspecified Cramer-Rao bound (MCRB) analysis, which reveals severe performance loss with even a small percentage of pixel failures. To remedy this issue, we develop two strategies for joint localization and failure diagnosis (JLFD) to detect failing pixels while simultaneously locating the UE with high accuracy. The first strategy relies on l_1-regularization through exploitation of failure sparsity. The second strategy detects the failures one-by-one by solving a multiple hypothesis testing problem at each iteration, successively enhancing localization and diagnosis accuracy. Simulation results show significant performance improvements of the proposed JLFD algorithms over the conventional failure-agnostic benchmark, enabling successful recovery of failure-induced performance degradations.


title: rMultiNet: An R Package For Multilayer Networks Analysis

abstract: This paper develops an R package rMultiNet to analyze multilayer network data. We provide two general frameworks from recent literature, e.g. mixture multilayer stochastic block model(MMSBM) and mixture multilayer latent space model(MMLSM) to generate the multilayer network. We also provide several methods to reveal the embedding of both nodes and layers followed by further data analysis methods, such as clustering. Three real data examples are processed in the package. The source code of rMultiNet is available at https://github.com/ChenyuzZZ73/rMultiNet.


title: An information-theoretic learning model based on importance sampling

abstract: A crucial assumption underlying the most current theory of machine learning is that the training distribution is identical to the test distribution. However, this assumption may not hold in some real-world applications. In this paper, we develop a learning model based on principles of information theory by minimizing the worst-case loss at prescribed levels of uncertainty. We reformulate the empirical estimation of the risk functional and the distribution deviation constraint based on the importance sampling method. The objective of the proposed approach is to minimize the loss under maximum degradation and hence the resulting problem is a minimax problem which can be converted to an unconstrained minimum problem using the Lagrange method with the Lagrange multiplier $T$. We reveal that the minimization of the objective function under logarithmic transformation is equivalent to the minimization of the p-norm loss with $p=\frac{1}{T}$. We applied the proposed model to the face verification task on Racial Faces in the Wild datasets and showed that the proposed model performs better under large distribution deviations.


title: Recent Advances in the Internet of Medical Things (IoMT) Systems Security

abstract: The rapid evolutions in micro-computing, mini-hardware manufacturing, and machine to machine (M2M) communications have enabled novel Internet of Things (IoT) solutions to reshape many networking applications. Healthcare systems are among these applications that have been revolutionized with IoT, introducing an IoT branch known as the Internet of Medical Things (IoMT) systems. IoMT systems allow remote monitoring of patients with chronic diseases. Thus, it can provide timely patients' diagnostic that can save their life in case of emergencies. However, security in these critical systems is a major challenge facing their wide utilization. In this paper, we present state-of-the-art techniques to secure IoMT systems' data during collection, transmission, and storage. We comprehensively overview IoMT systems' potential attacks, including physical and network attacks. Our findings reveal that most security techniques do not consider various types of attacks. Hence, we propose a security framework that combines several security techniques. The framework covers IoMT security requirements and can mitigate most of its known attacks.


title: Feature Likelihood Divergence: Evaluating the Generalization of Generative Models Using Samples

abstract: The past few years have seen impressive progress in the development of deep generative models capable of producing high-dimensional, complex, and photo-realistic data. However, current methods for evaluating such models remain incomplete: standard likelihood-based metrics do not always apply and rarely correlate with perceptual fidelity, while sample-based metrics, such as FID, are insensitive to overfitting, i.e., inability to generalize beyond the training set. To address these limitations, we propose a new metric called the Feature Likelihood Divergence (FLD), a parametric sample-based metric that uses density estimation to provide a comprehensive trichotomic evaluation accounting for novelty (i.e., different from the training samples), fidelity, and diversity of generated samples. We empirically demonstrate the ability of FLD to identify overfitting problem cases, even when previously proposed metrics fail. We also extensively evaluate FLD on various image datasets and model classes, demonstrating its ability to match intuitions of previous metrics like FID while offering a more comprehensive evaluation of generative models. Code is available at https://github.com/marcojira/fld.


title: Multi-task Representation Learning for Pure Exploration in Linear Bandits

abstract: Despite the recent success of representation learning in sequential decision making, the study of the pure exploration scenario (i.e., identify the best option and minimize the sample complexity) is still limited. In this paper, we study multi-task representation learning for best arm identification in linear bandits (RepBAI-LB) and best policy identification in contextual linear bandits (RepBPI-CLB), two popular pure exploration settings with wide applications, e.g., clinical trials and web content optimization. In these two problems, all tasks share a common low-dimensional linear representation, and our goal is to leverage this feature to accelerate the best arm (policy) identification process for all tasks. For these problems, we design computationally and sample efficient algorithms DouExpDes and C-DouExpDes, which perform double experimental designs to plan optimal sample allocations for learning the global representation. We show that by learning the common representation among tasks, our sample complexity is significantly better than that of the native approach which solves tasks independently. To the best of our knowledge, this is the first work to demonstrate the benefits of representation learning for multi-task pure exploration.


title: Calorimetric measurement of nuclear spin-lattice relaxation rate in metals

abstract: The quasiparticle density of states in correlated and quantum-critical metals directly probes the effect of electronic correlations on the Fermi surface. Measurements of the nuclear spin-lattice relaxation rate provide one such experimental probe of quasiparticle mass through the electronic density of states. By far the most common way of accessing the spin-lattice relaxation rate is via nuclear magnetic resonance and nuclear quadrupole resonance experiments, which require resonant excitation of nuclear spin transitions. Here we report non-resonant access to spin-lattice relaxation dynamics in AC-calorimetric measurements. The nuclear spin-lattice relaxation rate is inferred in our measurements from its effect on the frequency dispersion of the thermal response of the calorimeter-sample assembly. We use fast, lithographically-defined nanocalorimeters to access the nuclear spin-lattice relaxation times in metallic indium from 0.3~K to 7~K and in magnetic fields up to 35~T.


title: Enhancing E-Commerce Recommendation using Pre-Trained Language Model and Fine-Tuning

abstract: Pretrained Language Models (PLM) have been greatly successful on a board range of natural language processing (NLP) tasks. However, it has just started being applied to the domain of recommendation systems. Traditional recommendation algorithms failed to incorporate the rich textual information in e-commerce datasets, which hinderss the performance of those models. We present a thorough investigation on the effect of various strategy of incorporating PLMs into traditional recommender algorithms on one of the e-commerce datasets, and we compare the results with vanilla recommender baseline models. We show that the application of PLMs and domain specific fine-tuning lead to an increase on the predictive capability of combined models. These results accentuate the importance of utilizing textual information in the context of e-commerce, and provides insight on how to better apply PLMs alongside traditional recommender system algorithms. The code used in this paper is available on Github: https://github.com/NuofanXu/bert_retail_recommender.


title: On the non-discreteness of automorphism groups of Cayley graphs of Coxeter groups

abstract: In this work we characterise Cayley graphs of Coxeter groups with respect to the standard generating set that admit uncountable vertex stabilisers. As a corollary, we fully identify finitely generated Coxeter groups for which the automorphism group of their Cayley graph with respect to the standard generating set is not discrete when equipped with the permutation topology. As an application, we also provide new explicit constructions of vertex-transitive graphs of infinite degree that have locally compact automorphism groups.


title: Quantum Multi-Agent Actor-Critic Networks for Cooperative Mobile Access in Multi-UAV Systems

abstract: This paper proposes a novel algorithm, named quantum multi-agent actor-critic networks (QMACN) for autonomously constructing a robust mobile access system employing multiple unmanned aerial vehicles (UAVs). In the context of facilitating collaboration among multiple unmanned aerial vehicles (UAVs), the application of multi-agent reinforcement learning (MARL) techniques is regarded as a promising approach. These methods enable UAVs to learn collectively, optimizing their actions within a shared environment, ultimately leading to more efficient cooperative behavior. Furthermore, the principles of a quantum computing (QC) are employed in our study to enhance the training process and inference capabilities of the UAVs involved. By leveraging the unique computational advantages of quantum computing, our approach aims to boost the overall effectiveness of the UAV system. However, employing a QC introduces scalability challenges due to the near intermediate-scale quantum (NISQ) limitation associated with qubit usage. The proposed algorithm addresses this issue by implementing a quantum centralized critic, effectively mitigating the constraints imposed by NISQ limitations. Additionally, the advantages of the QMACN with performance improvements in terms of training speed and wireless service quality are verified via various data-intensive evaluations. Furthermore, this paper validates that a noise injection scheme can be used for handling environmental uncertainties in order to realize robust mobile access.


abstract: In this paper, we define and study Clifford quadratic complete intersections. After showing some properties of Clifford quantum polynomial algebras, we show that there is a natural one-to-one correspondence between Clifford quadratic complete intersections and commutative quadratic complete intersections. As an application, we give a classification of Clifford quadratic complete intersections in three variables in terms of their characteristic varieties.


title: Contour Completion using Deep Structural Priors

abstract: Humans can easily perceive illusory contours and complete missing forms in fragmented shapes. This work investigates whether such capability can arise in convolutional neural networks (CNNs) using deep structural priors computed directly from images. In this work, we present a framework that completes disconnected contours and connects fragmented lines and curves. In our framework, we propose a model that does not even need to know which regions of the contour are eliminated. We introduce an iterative process that completes an incomplete image and we propose novel measures that guide this to find regions it needs to complete. Our model trains on a single image and fills in the contours with no additional training data. Our work builds a robust framework to achieve contour completion using deep structural priors and extensively investigate how such a model could be implemented.


title: Model Chemistry Recommendations for Scaled Harmonic Frequency Calculations: A Benchmark Study

abstract: Despite the popularity of scaled harmonic frequency calculations in chemistry, sparse benchmarking is available to guide users on appropriate level of theory and basis set choices (model chemistry). Here, we assess the performance of over 600 model chemistries in scaled harmonic frequencies calculations evaluating different scaling factors types. We can summarise our results into three main findings: (1) using model chemistry-specific scaling factors optimised for three different frequency regions (low (below 1,000cm-1), mid (1,000-2,000cm-1), and high (above 2,000cm-1)) results in better agreement between the scaled harmonic and experimental frequencies compared to other choices; (2) larger basis sets and more robust levels of theory generally lead to superior performance; however, the particular model chemistry choice matters; and (3) outliers should be expected in routine calculations. In terms of specific recommendations, overall, the highest accuracy model chemistries are double-hybrid functionals with non-Pople augmented triple-zeta basis sets, which can produce median frequency errors of down to 7.6cm-1 (DSD-PBEP86/def2-TZVPD) lying close to the error in the harmonic approximation. Double-zeta basis sets should not be used with double-hybrid functionals as there is no improvement compared to hybrid functionals. Note that the 6-311G* and 6-311+G* bases perform like double-zeta basis sets for vibrational frequencies. After scaling, all studied hybrid functionals with non-Pople triple-zeta basis sets will produce median errors of less than 15cm-1, with the best result of 9.9cm-1 with B97-1/def2-TZVPD. Appropriate matching of double-zeta basis sets with hybrid functionals can produce high quality results. The B97-1, TPSS0-D3(BJ) or wB97X-D hybrid functionals with 6-31G*, pc-1 or pcseg-1 are recommended for fast routine calculations, all delivering median errors of 11-12cm-1.


title: Read and Reap the Rewards: Learning to Play Atari with the Help of Instruction Manuals

abstract: High sample complexity has long been a challenge for RL. On the other hand, humans learn to perform tasks not only from interaction or demonstrations, but also by reading unstructured text documents, e.g., instruction manuals. Instruction manuals and wiki pages are among the most abundant data that could inform agents of valuable features and policies or task-specific environmental dynamics and reward structures. Therefore, we hypothesize that the ability to utilize human-written instruction manuals to assist learning policies for specific tasks should lead to a more efficient and better-performing agent. We propose the Read and Reward framework. Read and Reward speeds up RL algorithms on Atari games by reading manuals released by the Atari game developers. Our framework consists of a QA Extraction module that extracts and summarizes relevant information from the manual and a Reasoning module that evaluates object-agent interactions based on information from the manual. An auxiliary reward is then provided to a standard A2C RL agent, when interaction is detected. Experimentally, various RL algorithms obtain significant improvement in performance and training speed when assisted by our design.


title: Tracking Fringe and Coordinated Activity on Twitter Leading Up To the US Capitol Attack

abstract: The aftermath of the 2020 US Presidential Election witnessed an unprecedented attack on the democratic values of the country through the violent insurrection at Capitol Hill on January 6th, 2021. The attack was fueled by the proliferation of conspiracy theories and misleading claims about the integrity of the election pushed by political elites and fringe communities on social media. In this study, we explore the evolution of fringe content and conspiracy theories on Twitter in the seven months leading up to the Capitol attack. We examine the suspicious coordinated activity carried out by users sharing fringe content, finding evidence of common adversarial manipulation techniques ranging from targeted amplification to manufactured consensus. Further, we map out the temporal evolution of, and the relationship between, fringe and conspiracy theories, which eventually coalesced into the rhetoric of a stolen election, with the hashtag #stopthesteal, alongside QAnon-related narratives. Our findings further highlight how social media platforms offer fertile ground for the widespread proliferation of conspiracies during major societal events, which can potentially lead to offline coordinated actions and organized violence.


title: Generalization in Graph Neural Networks: Improved PAC-Bayesian Bounds on Graph Diffusion

abstract: Graph neural networks are widely used tools for graph prediction tasks. Motivated by their empirical performance, prior works have developed generalization bounds for graph neural networks, which scale with graph structures in terms of the maximum degree. In this paper, we present generalization bounds that instead scale with the largest singular value of the graph neural network's feature diffusion matrix. These bounds are numerically much smaller than prior bounds for real-world graphs. We also construct a lower bound of the generalization gap that matches our upper bound asymptotically. To achieve these results, we analyze a unified model that includes prior works' settings (i.e., convolutional and message-passing networks) and new settings (i.e., graph isomorphism networks). Our key idea is to measure the stability of graph neural networks against noise perturbations using Hessians. Empirically, we find that Hessian-based measurements correlate with the observed generalization gaps of graph neural networks accurately. Optimizing noise stability properties for fine-tuning pretrained graph neural networks also improves test performance on several graph-level classification tasks.


title: An Information-Theoretic Analysis of Nonstationary Bandit Learning

abstract: In nonstationary bandit learning problems, the decision-maker must continually gather information and adapt their action selection as the latent state of the environment evolves. In each time period, some latent optimal action maximizes expected reward under the environment state. We view the optimal action sequence as a stochastic process, and take an information-theoretic approach to analyze attainable performance. We bound limiting per-period regret in terms of the entropy rate of the optimal action process. The bound applies to a wide array of problems studied in the literature and reflects the problem's information structure through its information-ratio.


title: Data Quality-aware Mixed-precision Quantization via Hybrid Reinforcement Learning

abstract: Mixed-precision quantization mostly predetermines the model bit-width settings before actual training due to the non-differential bit-width sampling process, obtaining sub-optimal performance. Worse still, the conventional static quality-consistent training setting, i.e., all data is assumed to be of the same quality across training and inference, overlooks data quality changes in real-world applications which may lead to poor robustness of the quantized models. In this paper, we propose a novel Data Quality-aware Mixed-precision Quantization framework, dubbed DQMQ, to dynamically adapt quantization bit-widths to different data qualities. The adaption is based on a bit-width decision policy that can be learned jointly with the quantization training. Concretely, DQMQ is modeled as a hybrid reinforcement learning (RL) task that combines model-based policy optimization with supervised quantization training. By relaxing the discrete bit-width sampling to a continuous probability distribution that is encoded with few learnable parameters, DQMQ is differentiable and can be directly optimized end-to-end with a hybrid optimization target considering both task performance and quantization benefits. Trained on mixed-quality image datasets, DQMQ can implicitly select the most proper bit-width for each layer when facing uneven input qualities. Extensive experiments on various benchmark datasets and networks demonstrate the superiority of DQMQ against existing fixed/mixed-precision quantization methods.


title: Genuine standstill in the AM CVn star CR Boo

abstract: CR Boo is one of the brightest and most famous AM CVn stars showing dwarf nova-type outbursts. Previous studies showed different modes of outbursts in this object ranging from the one equivalent to a hydrogen-rich ER UMa star or WZ Sge star to a low-amplitude oscillating state. We for the first time identified a bona fide standstill in this object in 2022 and we consider that CR Boo is a helium analog of Z Cam stars in addition to its SU UMa/ER UMa-type classification. The standstill lasted for ~60 d with variations typically less than 0.2 mag and ended with fading. This standstill was not preceded by a superoutburst and was different from a post-superoutburst phenomenon. The brightness after the standstill was similar to those after superoutbursts and the standstill appears to have acted like a superoutburst in effectively accreting the disk mass. The existence of a standstill in an AM CVn star be a challenge to theories of a helium disk or a degenerate secondary to explain how such a state could be maintained.


title: Rehabilitating Homeless: Dataset and Key Insights

abstract: This paper presents a large anonymized dataset of homelessness alongside insights into the data-driven rehabilitation of homeless people. The dataset was gathered by a large nonprofit organization working on rehabilitating the homeless for twenty years. This is the first dataset that we know of that contains rich information on thousands of homeless individuals seeking rehabilitation. We show how data analysis can help to make the rehabilitation of homeless people more effective and successful. Thus, we hope this paper alerts the data science community to the problem of homelessness.


title: ERNIE-Music: Text-to-Waveform Music Generation with Diffusion Models

abstract: In recent years, the burgeoning interest in diffusion models has led to significant advances in image and speech generation. Nevertheless, the direct synthesis of music waveforms from unrestricted textual prompts remains a relatively underexplored domain. In response to this lacuna, this paper introduces a pioneering contribution in the form of a text-to-waveform music generation model, underpinned by the utilization of diffusion models. Our methodology hinges on the innovative incorporation of free-form textual prompts as conditional factors to guide the waveform generation process within the diffusion model framework. Addressing the challenge of limited text-music parallel data, we undertake the creation of a dataset by harnessing web resources, a task facilitated by weak supervision techniques. Furthermore, a rigorous empirical inquiry is undertaken to contrast the efficacy of two distinct prompt formats for text conditioning, namely, music tags and unconstrained textual descriptions. The outcomes of this comparative analysis affirm the superior performance of our proposed model in terms of enhancing text-music relevance. Finally, our work culminates in a demonstrative exhibition of the excellent capabilities of our model in text-to-music generation. We further demonstrate that our generated music in the waveform domain outperforms previous works by a large margin in terms of diversity, quality, and text-music relevance.


title: Imperceptible Sample-Specific Backdoor to DNN with Denoising Autoencoder

abstract: The backdoor attack poses a new security threat to deep neural networks. Existing backdoor often relies on visible universal trigger to make the backdoored model malfunction, which are not only usually visually suspicious to human but also catchable by mainstream countermeasures. We propose an imperceptible sample-specific backdoor that the trigger varies from sample to sample and invisible. Our trigger generation is automated through a desnoising autoencoder that is fed with delicate but pervasive features (i.e., edge patterns per images). We extensively experiment our backdoor attack on ImageNet and MS-Celeb-1M, which demonstrates stable and nearly 100% (i.e., 99.8%) attack success rate with negligible impact on the clean data accuracy of the infected model. The denoising autoeconder based trigger generator is reusable or transferable across tasks (e.g., from ImageNet to MS-Celeb-1M), whilst the trigger has high exclusiveness (i.e., a trigger generated for one sample is not applicable to another sample). Besides, our proposed backdoored model has achieved high evasiveness against mainstream backdoor defenses such as Neural Cleanse, STRIP, SentiNet and Fine-Pruning.


title: Decomposition of Pythagorean representations of R. Thompson's groups

abstract: We continue to study Pythagorean unitary representation of Richard Thompson's groups $F$, $T$ and $V$ that are built from a single isometry from a Hilbert space to its double. By developing powerful diagrammatically based techniques we show that each such representation splits into a diffuse and an atomic parts. We previously proved that the diffuse part is Ind-mixing: it does not contain induced representations of finite-dimensional ones. We fully decompose the atomic part: the building blocks are monomial representations arising from a precise family of parabolic subgroups of $F$.


title: Global Constraints with Prompting for Zero-Shot Event Argument Classification

abstract: Determining the role of event arguments is a crucial subtask of event extraction. Most previous supervised models leverage costly annotations, which is not practical for open-domain applications. In this work, we propose to use global constraints with prompting to effectively tackles event argument classification without any annotation and task-specific training. Specifically, given an event and its associated passage, the model first creates several new passages by prefix prompts and cloze prompts, where prefix prompts indicate event type and trigger span, and cloze prompts connect each candidate role with the target argument span. Then, a pre-trained language model scores the new passages, making the initial prediction. Our novel prompt templates can easily adapt to all events and argument types without manual effort. Next, the model regularizes the prediction by global constraints exploiting cross-task, cross-argument, and cross-event relations. Extensive experiments demonstrate our model's effectiveness: it outperforms the best zero-shot baselines by 12.5% and 10.9% F1 on ACE and ERE with given argument spans and by 4.3% and 3.3% F1, respectively, without given argument spans. We have made our code publicly available.


title: Bag of Tricks for Training Data Extraction from Language Models

abstract: With the advance of language models, privacy protection is receiving more attention. Training data extraction is therefore of great importance, as it can serve as a potential tool to assess privacy leakage. However, due to the difficulty of this task, most of the existing methods are proof-of-concept and still not effective enough. In this paper, we investigate and benchmark tricks for improving training data extraction using a publicly available dataset. Because most existing extraction methods use a pipeline of generating-then-ranking, i.e., generating text candidates as potential training data and then ranking them based on specific criteria, our research focuses on the tricks for both text generation (e.g., sampling strategy) and text ranking (e.g., token-level criteria). The experimental results show that several previously overlooked tricks can be crucial to the success of training data extraction. Based on the GPT-Neo 1.3B evaluation results, our proposed tricks outperform the baseline by a large margin in most cases, providing a much stronger baseline for future research. The code is available at https://github.com/weichen-yu/LM-Extraction.


title: Hubbard-Stratonovich Detector for Simple Trainable MIMO Signal Detection

abstract: Massive multiple-input multiple-output (MIMO) is a key technology used in fifth-generation wireless communication networks and beyond. Recently, various MIMO signal detectors based on deep learning have been proposed. Especially, deep unfolding (DU), which involves unrolling of an existing iterative algorithm and embedding of trainable parameters, has been applied with remarkable detection performance. Although DU has a lesser number of trainable parameters than conventional deep neural networks, the computational complexities related to training and execution have been problematic because DU-based MIMO detectors usually utilize matrix inversion to improve their detection performance. In this study, we attempted to construct a DU-based trainable MIMO detector with the simplest structure. The proposed detector based on the Hubbard--Stratonovich (HS) transformation and DU is called the trainable HS (THS) detector. It requires only $O(1)$ trainable parameters and its training and execution cost is $O(n^2)$ per iteration, where $n$ is the number of transmitting antennas. Numerical results show that the detection performance of the THS detector is better than that of existing algorithms of the same complexity and close to that of a DU-based detector, which has higher training and execution costs than the THS detector.


title: Nonlinear Random Matrices and Applications to the Sum of Squares Hierarchy

abstract: We develop new tools in the theory of nonlinear random matrices and apply them to study the performance of the Sum of Squares (SoS) hierarchy on average-case problems. The SoS hierarchy is a powerful optimization technique that has achieved tremendous success for various problems in combinatorial optimization, robust statistics and machine learning. It's a family of convex relaxations that lets us smoothly trade off running time for approximation guarantees. In recent works, it's been shown to be extremely useful for recovering structure in high dimensional noisy data. It also remains our best approach towards refuting the notorious Unique Games Conjecture. In this work, we analyze the performance of the SoS hierarchy on fundamental problems stemming from statistics, theoretical computer science and statistical physics. In particular, we show subexponential-time SoS lower bounds for the problems of the Sherrington-Kirkpatrick Hamiltonian, Planted Slightly Denser Subgraph, Tensor Principal Components Analysis and Sparse Principal Components Analysis. These SoS lower bounds involve analyzing large random matrices, wherein lie our main contributions. These results offer strong evidence for the truth of and insight into the low-degree likelihood ratio hypothesis, an important conjecture that predicts the power of bounded-time algorithms for hypothesis testing. We also develop general-purpose tools for analyzing the behavior of random matrices which are functions of independent random variables. Towards this, we build on and generalize the matrix variant of the Efron-Stein inequalities. In particular, our general theorem on matrix concentration recovers various results that have appeared in the literature. We expect these random matrix theory ideas to have other significant applications.


title: Practical Privacy Preservation in a Mobile Cloud Environment

abstract: The proliferation of smartphone devices has led to the emergence of powerful user services from enabling interactions with friends and business associates to mapping, finding nearby businesses and alerting users in real-time. Moreover, users do not realize that continuously sharing their trajectory data with online systems may end up revealing a great amount of information in terms of their behavior, mobility patterns and social relationships. Thus, addressing these privacy risks is a fundamental challenge. In this work, we present $TP^3$, a Privacy Protection system for Trajectory analytics. Our contributions are the following: (1) we model a new type of attack, namely 'social link exploitation attack', (2) we utilize the coresets theory, a fast and accurate technique which approximates well the original data using a small data set, and running queries on the coreset produces similar results to the original data, and (3) we employ the Serverless computing paradigm to accommodate a set of privacy operations for achieving high system performance with minimized provisioning costs, while preserving the users' privacy. We have developed these techniques in our $TP^3$ system that works with state-of-the-art trajectory analytics apps and applies different types of privacy operations. Our detailed experimental evaluation illustrates that our approach is both efficient and practical.


title: Towards Fairer and More Efficient Federated Learning via Multidimensional Personalized Edge Models

abstract: Federated learning (FL) is an emerging technique that trains massive and geographically distributed edge data while maintaining privacy. However, FL has inherent challenges in terms of fairness and computational efficiency due to the rising heterogeneity of edges, and thus usually results in sub-optimal performance in recent state-of-the-art (SOTA) solutions. In this paper, we propose a Customized Federated Learning (CFL) system to eliminate FL heterogeneity from multiple dimensions. Specifically, CFL tailors personalized models from the specially designed global model for each client jointly guided by an online trained model-search helper and a novel aggregation algorithm. Extensive experiments demonstrate that CFL has full-stack advantages for both FL training and edge reasoning and significantly improves the SOTA performance w.r.t. model accuracy (up to 7.2% in the non-heterogeneous environment and up to 21.8% in the heterogeneous environment), efficiency, and FL fairness.


title: Detecting Contextomized Quotes in News Headlines by Contrastive Learning

abstract: Quotes are critical for establishing credibility in news articles. A direct quote enclosed in quotation marks has a strong visual appeal and is a sign of a reliable citation. Unfortunately, this journalistic practice is not strictly followed, and a quote in the headline is often "contextomized." Such a quote uses words out of context in a way that alters the speaker's intention so that there is no semantically matching quote in the body text. We present QuoteCSE, a contrastive learning framework that represents the embedding of news quotes based on domain-driven positive and negative samples to identify such an editorial strategy. The dataset and code are available at https://github.com/ssu-humane/contextomized-quote-contrastive.


title: A noncommutative weak type maximal inequality for modulated ergodic averages with general weights

abstract: In this article, we prove a weak type $(p,p)$ maximal inequality, $1<p<\infty$, for weighted averages of a positive Dunford-Schwarz operator $T$ acting on a noncommutative $L_p$-space associated to a semifinite von Neumann algebra $\mathcal{M}$, with weights in $W_q$, where $\frac{1}{p}+\frac{1}{q}=1$. This result is then utilized to obtain modulated individual ergodic theorems with $q$-Besicovitch and $q$-Hartman sequences as weights. Multiparameter versions of these results are also investigated.


title: Contact and metric structures in black hole chemistry

abstract: We review recent studies of contact and thermodynamic geometry for black holes in AdS spacetimes in the extended thermodynamics framework. The cosmological constant gives rise to the notion of pressure $P = -\Lambda / 8 \pi$ and, subsequently a conjugate volume $V$, thereby leading to a close analogy with hydrostatic thermodynamic systems. To begin with, we review the contact geometry approach to thermodynamics in general and then consider thermodynamic metrics constructed as the Hessians of various thermodynamic potentials. We then study their correspondence to statistical ensembles for systems with two-dimensional spaces of equilibrium states. From the zeroes and divergences of the curvature scalar obtained from the metric, we carefully analyze the issue of ensemble non-equivalence and show certain complimentary behaviors in the description of a thermodynamic system. Following a thorough analysis of the familiar van der Waals system, we turn our attention to black holes in extended phase space. Considering the example of charged AdS black holes, we discuss the generic features of their thermodynamic geometry in detail. The relationship of the thermodynamic curvature(s) with critical points as well as microscopic interactions in black holes is also briefly explored. We finally set up the thermodynamic geometry for finite temperature gauge theories dual to black holes in AdS via holographic correspondence and comment on recent progress.


title: Disentangling $1/f$ noise from confined ion dynamics

abstract: Ion transport through biological and solid-state nanochannels is known to be a highly noisy process. The power spectrum of current fluctuations is empirically known to scale like the inverse of frequency, following the long-standing yet poorly understood Hooge's law. Here, we report measurements of current fluctuations across nanometer-scale two-dimensional channels with different surface properties. The structure of fluctuations is found to depend on channel's material. While in pristine channels current fluctuations scale like $1/f^{1+a}$ with $a = 0 - 0.5$, the noise power spectrum of activated graphite channels displays different regimes depending on frequency. Based on these observations, we develop a theoretical formalism directly linking ion dynamics and current fluctuations. We predict that the noise power spectrum take the form $1/f \times S_\text{channel}(f)$, where $1/f$ fluctuations emerge in fluidic reservoirs on both sides of the channel and $S_\text{channel}$ describes fluctuations inside it. Deviations to Hooge's law thus allow direct access to the ion transport dynamics of the channel -- explaining the entire phenomenology observed in experiments on 2D nanochannels. Our results demonstrate how current fluctuations can be used to characterize nanoscale ion dynamics.


title: Joint Acoustic Echo Cancellation and Speech Dereverberation Using Kalman filters

abstract: This paper proposes a joint acoustic echo cancellation (AEC) and speech dereverberation (DR) algorithm in the short-time Fourier transform domain. The reverberant microphone signals are described using an auto-regressive (AR) model. The AR coefficients and the loudspeaker-to-microphone acoustic transfer functions (ATFs) are considered time-varying and are modeled simultaneously using a first-order Markov process. This leads to a solution where these parameters can be optimally estimated using Kalman filters. It is shown that the proposed algorithm outperforms vanilla solutions that solve AEC and DR sequentially and one state-of-the-art joint DRAEC algorithm based on semi-blind source separation, in terms of both speech quality and echo reduction performance.


title: Pego theorem on compact groups

abstract: The Pego theorem characterizes the precompact subsets of the square-integrable functions on $\mathbb{R}^n$ via the Fourier transform. We prove the analogue of the Pego theorem on compact groups (not necessarily abelian).


title: Remnants of recent mergers in nearby early-type galaxies and their classification

abstract: We search for signatures of recent galaxy close interactions and mergers in a sample of 202 early-type galaxies in the local universe from the public SDSS Stripe82 deep images ($\mu_r \sim 28.5$ mag arcsec$^{-2}$). Using two different methods to remove galaxies' smooth and symmetric light distribution, we identify and characterize eleven distinct types of merger remnants embedded in the diffuse light of these early-type galaxies. We discuss how the morphology of merger remnants can result from different kinds of minor and major mergers, and estimate the fraction of early-type galaxies in the local universe with evidence of recent major (27%) and minor (57%) mergers. The merger fractions deduced are higher than in several earlier surveys. Among remnants, we find that shells are the dominant merger debris (54%) associated with early-type galaxies, resulting from both major and minor mergers, with those characteristics of major mergers being significant (24% of shell host galaxies). The most uncommon merger-related structures are boxy isophotes of the stellar distribution and the presence of disk fragments near the cores of galaxies. We develop a classification scheme for these fine structures that may be used to infer their likely genesis histories. The classification is primarily based on the mass ratios of the merged galaxies. This work, when combined with predictions from numerical simulations, indicates that most (if not all) early-type galaxies in the local Universe are continually evolving as a result of (minor) merger activities.


title: A characterization of irreducible Hermitian symmetric spaces of tube type by $\mathbb{C}^{*}$-actions

abstract: A $\mathbb{C}^{*}$-action on a projective variety $X$ is said to be of Euler type at a nonsingular fixed point $x$ if the isotropy action of $\mathbb{C}^{*}$ on $T_{x}X$ is by scalar multiplication. In this paper, it's proven that a smooth projective variety of Picard number one $X$ is isomorphic to an irreducible Hermitian symmetric space of tube type if and only if for a general pair of points $x,y$ on $X$, there exists a $\mathbb{C}^{*}$-action on $X$ which is of Euler type at $x$ and its inverse action is of Euler type at $y$.


title: A Comprehensive Survey on Multimodal Recommender Systems: Taxonomy, Evaluation, and Future Directions

abstract: Recommendation systems have become popular and effective tools to help users discover their interesting items by modeling the user preference and item property based on implicit interactions (e.g., purchasing and clicking). Humans perceive the world by processing the modality signals (e.g., audio, text and image), which inspired researchers to build a recommender system that can understand and interpret data from different modalities. Those models could capture the hidden relations between different modalities and possibly recover the complementary information which can not be captured by a uni-modal approach and implicit interactions. The goal of this survey is to provide a comprehensive review of the recent research efforts on the multimodal recommendation. Specifically, it shows a clear pipeline with commonly used techniques in each step and classifies the models by the methods used. Additionally, a code framework has been designed that helps researchers new in this area to understand the principles and techniques, and easily runs the SOTA models. Our framework is located at: https://github.com/enoche/MMRec


title: On-Chip Chemical Sensing Using Double-slot Silicon Waveguide

abstract: In this paper, we present refractive index measurement using a double-slot silicon waveguide-based Mach Zehnder interferometer. We present a double-slot waveguide that offers the best sensitivity and limit of detection compared to wire and single-slot waveguides. We demonstrate ultra-low loss coupling between a single-mode waveguide and a double-slot waveguide and experimental proof for double-slot excitation. The double-slot waveguide is used to demonstrate a highly sensitive concentration sensor. An unbalanced Mach-Zehnder is used as the sensor device to demonstrate concentrations of Potassium Chloride in deionized water. A sensitivity of 700 nm/RIU and a limit of detection (LOD) of 7.142e^-6 RIU are achieved experimentally. To the best of our knowledge, the demonstrated sensitivity is the highest for an on-chip guided waveguide sensing scheme.


title: Locally consistent decomposition of strings with applications to edit distance sketching

abstract: In this paper we provide a new locally consistent decomposition of strings. Each string $x$ is decomposed into blocks that can be described by grammars of size $\widetilde{O}(k)$ (using some amount of randomness). If we take two strings $x$ and $y$ of edit distance at most $k$ then their block decomposition uses the same number of grammars and the $i$-th grammar of $x$ is the same as the $i$-th grammar of $y$ except for at most $k$ indexes $i$. The edit distance of $x$ and $y$ equals to the sum of edit distances of pairs of blocks where $x$ and $y$ differ. Our decomposition can be used to design a sketch of size $\widetilde{O}(k^2)$ for edit distance, and also a rolling sketch for edit distance of size $\widetilde{O}(k^2)$. The rolling sketch allows to update the sketched string by appending a symbol or removing a symbol from the beginning of the string.


title: Towards Geospatial Foundation Models via Continual Pretraining

abstract: Geospatial technologies are becoming increasingly essential in our world for a wide range of applications, including agriculture, urban planning, and disaster response. To help improve the applicability and performance of deep learning models on these geospatial tasks, various works have begun investigating foundation models for this domain. Researchers have explored two prominent approaches for introducing such models in geospatial applications, but both have drawbacks in terms of limited performance benefit or prohibitive training cost. Therefore, in this work, we propose a novel paradigm for building highly effective geospatial foundation models with minimal resource cost and carbon impact. We first construct a compact yet diverse dataset from multiple sources to promote feature diversity, which we term GeoPile. Then, we investigate the potential of continual pretraining from large-scale ImageNet-22k models and propose a multi-objective continual pretraining paradigm, which leverages the strong representations of ImageNet while simultaneously providing the freedom to learn valuable in-domain features. Our approach outperforms previous state-of-the-art geospatial pretraining methods in an extensive evaluation on seven downstream datasets covering various tasks such as change detection, classification, multi-label classification, semantic segmentation, and super-resolution.


title: An End-to-End Framework for Marketing Effectiveness Optimization under Budget Constraint

abstract: Online platforms often incentivize consumers to improve user engagement and platform revenue. Since different consumers might respond differently to incentives, individual-level budget allocation is an essential task in marketing campaigns. Recent advances in this field often address the budget allocation problem using a two-stage paradigm: the first stage estimates the individual-level treatment effects using causal inference algorithms, and the second stage invokes integer programming techniques to find the optimal budget allocation solution. Since the objectives of these two stages might not be perfectly aligned, such a two-stage paradigm could hurt the overall marketing effectiveness. In this paper, we propose a novel end-to-end framework to directly optimize the business goal under budget constraints. Our core idea is to construct a regularizer to represent the marketing goal and optimize it efficiently using gradient estimation techniques. As such, the obtained models can learn to maximize the marketing goal directly and precisely. We extensively evaluate our proposed method in both offline and online experiments, and experimental results demonstrate that our method outperforms current state-of-the-art methods. Our proposed method is currently deployed to allocate marketing budgets for hundreds of millions of users on a short video platform and achieves significant business goal improvements. Our code will be publicly available.


title: Robotics in Elderly Healthcare: A Review of 20 Recent Research Projects

abstract: Studies show dramatic increase in elderly population of Western Europe over the next few decades, which will put pressure on healthcare systems. Measures must be taken to meet these social challenges. Healthcare robots investigated to facilitate independent living for elderly. This paper aims to review recent projects in robotics for healthcare from 2008 to 2021. We provide an overview of the focus in this area and a roadmap for upcoming research. Our study was initiated with a literature search using three digital databases. Searches were performed for articles, including research projects containing the words elderly care, assisted aging, health monitoring, or elderly health, and any word including the root word robot. The resulting 20 recent research projects are described and categorized in this paper. Then, these projects were analyzed using thematic analysis. Our findings can be summarized in common themes: most projects have a strong focus on care robots functionalities; robots are often seen as products in care settings; there is an emphasis on robots as commercial products; and there is some limited focus on the design and ethical aspects of care robots. The paper concludes with five key points representing a roadmap for future research addressing robotic for elderly people.


title: An Expressive Ansatz for Low-Depth Quantum Approximate Optimisation

abstract: The quantum approximate optimisation algorithm (QAOA) is a hybrid quantum-classical algorithm used to approximately solve combinatorial optimisation problems. It involves multiple iterations of a parameterised ansatz comprising a problem and mixer Hamiltonian, with the parameters being classically optimised. While QAOA can be implemented on NISQ devices, physical limitations can limit circuit depth and decrease performance. To address these limitations, this work introduces the eXpressive QAOA (XQAOA), an overparameterised variant of QAOA that assigns more classical parameters to the ansatz to improve its performance at low depths. XQAOA also introduces an additional Pauli-Y component in the mixer Hamiltonian, allowing the mixer to implement arbitrary unitary transformations on each qubit. To benchmark the performance of XQAOA at unit depth, we derive its closed-form expression for the MaxCut problem and compare it to QAOA, Multi-Angle QAOA (MA-QAOA), a classical-relaxed algorithm, and the state-of-the-art Goemans-Williamson algorithm on a set of unweighted regular graphs with 128 and 256 nodes for degrees ranging from 3 to 10. Our results indicate that at unit depth, XQAOA has benign loss landscapes, allowing it to consistently outperform QAOA, MA-QAOA, and the classical-relaxed algorithm on all graph instances and the Goemans-Williamson algorithm on graph instances with degrees greater than 4. Small-scale simulations also reveal that unit-depth XQAOA surpasses both QAOA and MA-QAOA on all tested depths up to five. Additionally, we find an infinite family of graphs for which XQAOA solves MaxCut exactly and analytically show that for some graphs in this family, XQAOA achieves a much larger approximation ratio than QAOA. Overall, XQAOA is a more viable choice for variational quantum optimisation on NISQ devices, offering competitive performance at low depths.


title: The range of a connection and a Calabi operator for Lorentzian locally symmetric spaces

abstract: For semi-Riemannian manifolds of constant sectional curvature, the Calabi operator is a second order linear differential operator that provides local integrability conditions for the range of the Killing operator. In this article, extending earlier results in the Riemannian setting, we identify the Lorentzian locally symmetric spaces on which the Calabi operator is sufficient to identify the range of the Killing operator. Specifically, this is always the case for indecomposable spaces and we identify precisely those products for which it fails. Our method is quite general in that we firstly develop criteria to be in the range of a connection, viewed as a linear differential operator. Then we ascertain how these criteria apply in the case of what we call the Killing connection.


title: A Hopfield-like model with complementary encodings of memories

abstract: We present a Hopfield-like autoassociative network for memories representing examples of concepts. Each memory is encoded by two activity patterns with complementary properties. The first is dense and correlated across examples within concepts, and the second is sparse and exhibits no correlation among examples. The network stores each memory as a linear combination of its encodings. During retrieval, the network recovers sparse or dense patterns with a high or low activity threshold, respectively. As more memories are stored, the dense representation at low threshold shifts from examples to concepts, which are learned from accumulating common example features. Meanwhile, the sparse representation at high threshold maintains distinctions between examples due to the high capacity of sparse, decorrelated patterns. Thus, a single network can retrieve memories at both example and concept scales and perform heteroassociation between them. We obtain our results by deriving macroscopic mean-field equations that yield capacity formulas for sparse examples, dense examples, and dense concepts. We also perform network simulations that verify our theoretical results and explicitly demonstrate the capabilities of the network.


title: Secret Sharing on Superconcentrator

abstract: Using information inequalities, we prove any unrestricted arithmetic circuits computing the shares of any $(t, n)$-threshold secret sharing scheme must satisfy some superconcentrator-like connection properties. In the reverse direction, we prove, when the underlying field is large enough, any graph satisfying these connection properties can be turned into a linear arithmetic circuit computing the shares of a $(t, n)$-threshold secret sharing scheme. Specifically, $n$ shares can be computed by a linear arithmetic circuits with $O(n)$ wires in depth $O(\alpha(t, n))$, where $\alpha(t, n)$ is the two-parameter version of the inverse Ackermann function. For example, when $n \ge t^{2.5}$, depth $2$ would be enough; when $n \ge t \log^{2.5} t$, depth 3 would be enough.


title: A simple and general approach for reversible condensation polymerization with cyclization

abstract: We develop a simple recursive approach to treat reversible condensation polymerization with cyclization. Based upon a minimum set of balance equations, the law of mass action, Gaussian chain statistics, and the assumption of independent reactions, we derive exact analytical solutions for systems without cyclization, for systems containing only smallest loops, or systems that exclusively form loops. Exact numerical solutions are computed for the general case of a homopolymerization of flexible precursor polymers. All solutions were tested with Monte-Carlo simulations. A generalization for good solvent is discussed and it is shown that this generalization agrees with preceding work in the limit of low and high polymer volume fractions. The new aspect of our approach is its flexibility that allows for a rather simple generalization to more complex situations. These include different kinds of reversible linear polymerization, non-linear polymerization, first shell substitution effect, semiflexibility, or a low molecular weight cut-off for cyclization.


title: Finite index rigidity of hyperbolic groups

abstract: We prove that the topological complexity of a finite index subgroup of a hyperbolic group is linear in its index. This follows from a more general result relating the size of the quotient of a free cocompact action of hyperbolic group on a graph to the minimal number of cells in a simplicial classifying space for the group. As a corollary we prove that any two isomorphic finite-index subgroups of a non-elementary hyperbolic group have the same index.


title: Strong correlation of the neutron star core-crust transition density with the $\sigma$-meson mass via vacuum polarization

abstract: We study the neutron star core-crust transition density $\rho_t$ with the inclusion of the vacuum polarization in the dielectric function in the nonlinear relativistic Hartree approach (RHAn). It is found that the strong correlation between the $\rho_{t}$ and the scalar meson mass $m_{\sigma}$ strikingly overwhelms the uncertainty of the nuclear equation of state in the RHAn models, in contrast to the usual awareness that $\rho_{t}$ is predominantly sensitive to the isovector nuclear potential and symmetry energy. The accurate extraction of $\rho_{t}$ through the future gravitational wave measurements can thus provide a strong constraint on the longstanding uncertainty of $m_{\sigma}$, which is of significance to better infer the vacuum property. As an astrophysical implication, it suggests that the correlation between $\rho_t$ and $m_\sigma$ is very favorable to reconcile the difficulty in reproducing the large crustal moment of inertia for the pulsar glitches with the well constrained symmetry energy.


title: A General Mobile Manipulator Automation Framework for Flexible Manufacturing in Hostile Industrial Environments

abstract: To enable a mobile manipulator to perform human tasks from a single teaching demonstration is vital to flexible manufacturing. We call our proposed method MMPA (Mobile Manipulator Process Automation with One-shot Teaching). Currently, there is no effective and robust MMPA framework which is not influenced by harsh industrial environments and the mobile base's parking precision. The proposed MMPA framework consists of two stages: collecting data (mobile base's location, environment information, end-effector's path) in the teaching stage for robot learning; letting the end-effector repeat the nearly same path as the reference path in the world frame to reproduce the work in the automation stage. More specifically, in the automation stage, the robot navigates to the specified location without the need of a precise parking. Then, based on colored point cloud registration, the proposed IPE (Iterative Pose Estimation by Eye & Hand) algorithm could estimate the accurate 6D relative parking pose of the robot arm base without the need of any marker. Finally, the robot could learn the error compensation from the parking pose's bias to modify the end-effector's path to make it repeat a nearly same path in the world coordinate system as recorded in the teaching stage. Hundreds of trials have been conducted with a real mobile manipulator to show the superior robustness of the system and the accuracy of the process automation regardless of the harsh industrial conditions and parking precision. For the released code, please contact marketing@amigaga.com


title: Large monochromatic components in colorings of complete hypergraphs

abstract: Gy\'arf\'as famously showed that in every $r$-coloring of the edges of the complete graph $K_n$, there is a monochromatic connected component with at least $\frac{n}{r-1}$ vertices. A recent line of study by Conlon, Tyomkyn, and the second author addresses the analogous question about monochromatic connected components with many edges. In this paper, we study a generalization of these questions for $k$-uniform hypergraphs. Over a wide range of extensions of the definition of connectivity to higher uniformities, we provide both upper and lower bounds for the size of the largest monochromatic component that are tight up to a factor of $1+o(1)$ as the number of colors grows. We further generalize these questions to ask about counts of vertex $s$-sets contained within the edges of large monochromatic components. We conclude with more precise results in the particular case of two colors.


title: PredRecon: A Prediction-boosted Planning Framework for Fast and High-quality Autonomous Aerial Reconstruction

abstract: Autonomous UAV path planning for 3D reconstruction has been actively studied in various applications for high-quality 3D models. However, most existing works have adopted explore-then-exploit, prior-based or exploration-based strategies, demonstrating inefficiency with repeated flight and low autonomy. In this paper, we propose PredRecon, a prediction-boosted planning framework that can autonomously generate paths for high 3D reconstruction quality. We obtain inspiration from humans can roughly infer the complete construction structure from partial observation. Hence, we devise a surface prediction module (SPM) to predict the coarse complete surfaces of the target from the current partial reconstruction. Then, the uncovered surfaces are produced by online volumetric mapping waiting for observation by UAV. Lastly, a hierarchical planner plans motions for 3D reconstruction, which sequentially finds efficient global coverage paths, plans local paths for maximizing the performance of Multi-View Stereo (MVS), and generates smooth trajectories for image-pose pairs acquisition. We conduct benchmarks in the realistic simulator, which validates the performance of PredRecon compared with the classical and state-of-the-art methods. The open-source code is released at https://github.com/HKUST-Aerial-Robotics/PredRecon.


title: Robust topological superconductivity in spin-orbit coupled systems at higher-order van Hove filling

abstract: Van Hove singularities (VHSs) in proximity to the Fermi level promote electronic interactions and generate diverse competing instabilities. It is also known that a nontrivial Berry phase derived from spin-orbit coupling (SOC) can introduce an intriguing decoration into the interactions and thus alter correlated phenomena. However, it is unclear how and what type of new physics can emerge in a system featured by the interplay between VHSs and the Berry phase. Here, based on a general Rashba model on the square lattice, we comprehensively explore such an interplay and its significant influence on the competing electronic instabilities by performing a parquet renormalization group analysis. Despite the existence of a variety of comparable fluctuations in the particle-particle and particle-hole channels associated with higher-order VHSs, we find that the chiral $p \pm ip$ pairings emerge as two stable fixed trajectories within the generic interaction parameter space, namely the system becomes a robust topological superconductor. The chiral pairings stem from the hopping interaction induced by the nontrivial Berry phase. The possible experimental realization and implications are discussed. Our work sheds new light on the correlated states in quantum materials with strong SOC and offers fresh insights into the exploration of topological superconductivity.


title: Charge density wave with strong quantum phase fluctuations in Kagome magnet FeGe

abstract: Charge density wave (CDW) can be characterized by the amplitude of its charge modulation and the spatial phase coherence amongst CDW superlattice unit cells. The phase coherence is usually guaranteed for weak-coupling CDW. However, McMillan [Phys. Rev. B 16, 643 (1977)] predicted that in the strong coupling regime, the phase fluctuation is strong and the coherence length of CDW could be just a few superlattice unit cell size; a short-ranged CDW exists above the transition, together with a CDW gap. In experiments, the short-ranged CDW with small domains is often associated with defects, thus making it difficult to identify the role of intrinsic phase fluctuations. Here, we report the observation of a short-ranged CDW in Kagome magnet FeGe far below its CDW transition temperature, and a pseudo gap in the non-CDW regions. Intriguingly, it can be disrupted by gentle scans in a scanning tunneling microscope, resulting in a metastable phase consisting of individual CDW nuclei independent of defects. Our first-principle calculations show optical phonons in a sizable momentum region soften similarly, which likely induces frustrations that could destroy the phase coherence. These findings put the CDW state in FeGe in the extreme strong-coupling limit with intrinsic quantum phase fluctuations, which enriches the current understanding of CDW in the strong coupling regime.


title: Reverse Algols and hydrogen-rich Wolf-Rayet stars from very massive binaries

abstract: Massive star feedback affects the evolution of galaxies, where the most massive stars may have the largest impact. The majority of massive stars are born as members of close binary systems. Here, we investigate detailed evolutionary models of very massive binaries (30$\dots$90$M_{\odot}$) with Large Magellanic Cloud (LMC) metallicity. We identify four effects defying the conventional knowledge of binary evolution, which are all related to the proximity of the models to the Eddington limit. We find that the majority of systems undergo mass transfer during core hydrogen burning. During the ensuing nuclear timescale evolution, many mass donors remain more massive than their companions (``reverse Algols''), and nuclear timescale mass transfer may be interrupted or absent altogether. Furthermore, due to the elevated luminosity-to-mass ratio, many of the core-hydrogen burning donors may develop Wolf-Rayet-type winds, at luminosities where single stars would not. We identify observational counterparts of very massive reverse Algol binaries in the LMC, and discuss their contribution to the observed hydrogen-rich Wolf-Rayet stars. We argue that an understanding of very massive Algol systems is key to predicting the advanced evolution of very massive binaries, including their ability to evolve into observable gravitational wave sources.


title: Tree Learning: Optimal Algorithms and Sample Complexity

abstract: We study the problem of learning a hierarchical tree representation of data from labeled samples, taken from an arbitrary (and possibly adversarial) distribution. Consider a collection of data tuples labeled according to their hierarchical structure. The smallest number of such tuples required in order to be able to accurately label subsequent tuples is of interest for data collection in machine learning. We present optimal sample complexity bounds for this problem in several learning settings, including (agnostic) PAC learning and online learning. Our results are based on tight bounds of the Natarajan and Littlestone dimensions of the associated problem. The corresponding tree classifiers can be constructed efficiently in near-linear time.


title: Admissible Skein Modules

abstract: In this paper we introduce the notion of admissible skein modules associated to an ideal in a pivotal category. We explain how these modules are generalizations of the Kauffman skein algebra and how they relate to renormalized quantum invariants coming from non-semisimple categories.


title: Adaptive large neighborhood search for a personnel task scheduling problem with task selection and parallel task assignments

abstract: Motivated by a real-world application, we model and solve a complex staff scheduling problem. Tasks are to be assigned to workers for supervision. Multiple tasks can be covered in parallel by a single worker, with worker shifts being flexible within availabilities. Each worker has a different skill set, enabling them to cover different tasks. Tasks require assignment according to priority and skill requirements. The objective is to maximize the number of assigned tasks weighted by their priorities, while minimizing assignment penalties. We develop an adaptive large neighborhood search (ALNS) algorithm, relying on tailored destroy and repair operators. It is tested on benchmark instances derived from real-world data and compared to optimal results obtained by means of a commercial MIP-solver. Furthermore, we analyze the impact of considering three additional alternative objective functions. When applied to large-scale company data, the developed ALNS outperforms the previously applied solution approach.


title: 3D reconstruction from spherical images: A review of techniques, applications, and prospects

abstract: 3D reconstruction plays an increasingly important role in modern photogrammetric systems. Conventional satellite or aerial-based remote sensing (RS) platforms can provide the necessary data sources for the 3D reconstruction of large-scale landforms and cities. Even with low-altitude UAVs (Unmanned Aerial Vehicles), 3D reconstruction in complicated situations, such as urban canyons and indoor scenes, is challenging due to frequent tracking failures between camera frames and high data collection costs. Recently, spherical images have been extensively used due to the capability of recording surrounding environments from one camera exposure. In contrast to perspective images with limited FOV (Field of View), spherical images can cover the whole scene with full horizontal and vertical FOV and facilitate camera tracking and data acquisition in these complex scenes. With the rapid evolution and extensive use of professional and consumer-grade spherical cameras, spherical images show great potential for the 3D modeling of urban and indoor scenes. Classical 3D reconstruction pipelines, however, cannot be directly used for spherical images. Besides, there exist few software packages that are designed for the 3D reconstruction of spherical images. As a result, this research provides a thorough survey of the state-of-the-art for 3D reconstruction of spherical images in terms of data acquisition, feature detection and matching, image orientation, and dense matching as well as presenting promising applications and discussing potential prospects. We anticipate that this study offers insightful clues to direct future research.


title: Dual Algorithmic Reasoning

abstract: Neural Algorithmic Reasoning is an emerging area of machine learning which seeks to infuse algorithmic computation in neural networks, typically by training neural models to approximate steps of classical algorithms. In this context, much of the current work has focused on learning reachability and shortest path graph algorithms, showing that joint learning on similar algorithms is beneficial for generalisation. However, when targeting more complex problems, such similar algorithms become more difficult to find. Here, we propose to learn algorithms by exploiting duality of the underlying algorithmic problem. Many algorithms solve optimisation problems. We demonstrate that simultaneously learning the dual definition of these optimisation problems in algorithmic learning allows for better learning and qualitatively better solutions. Specifically, we exploit the max-flow min-cut theorem to simultaneously learn these two algorithms over synthetically generated graphs, demonstrating the effectiveness of the proposed approach. We then validate the real-world utility of our dual algorithmic reasoner by deploying it on a challenging brain vessel classification task, which likely depends on the vessels' flow properties. We demonstrate a clear performance gain when using our model within such a context, and empirically show that learning the max-flow and min-cut algorithms together is critical for achieving such a result.