title: The Solidarity Cover Problem

abstract: Various real-world problems consist of partitioning a set of locations into disjoint subsets, each subset spread in a way that it covers the whole set with a certain radius. Given a finite set S, a metric d, and a radius r, define a subset (of S) S' to be an r-cover if and only if forall s in S there exists s' in S' such that d(s,s') is less or equal to r. We examine the problem of determining whether there exist m disjoint r-covers, naming it the Solidarity Cover Problem (SCP). We consider as well the related optimization problems of maximizing the number of r-covers, referred to as the partition size, and minimizing the radius. We analyze the relation between the SCP and a graph problem known as the Domatic Number Problem (DNP), both hard problems in the general case. We show that the SCP is hard already in the Euclidean 2D setting, implying hardness of the DNP already in the unit-disc-graph setting. As far as we know, the latter is a result yet to be shown. We use the tight approximation bound of (1-o(1))/ln(n) for the DNP's general case, shown by U.Feige, M.Halld'orsson, G.Kortsarz, and A.Srinivasan (SIAM Journal on computing, 2002), to deduce the same bound for partition-size approximation of the SCP in the Euclidean space setting. We show an upper bound of 3 and lower bounds of 2 and sqrt(2) for approximating the minimal radius in different settings of the SCP. Lastly, in the Euclidean 2D setting we provide a general bicriteria-approximation scheme which allows a range of possibilities for trading the optimality of the radius in return for better approximation of the partition size and vice versa. We demonstrate a usage of the scheme which achieves an approximation of (1/16,2) for the partition size and radius respectively.


title: Cache-Aided Communication Schemes via Combinatorial Designs and their $q$-analogs

abstract: We consider the standard broadcast setup with a single server broadcasting information to a number of clients, each of which contains local storage (called cache) of some size, which can store some parts of the available files at the server. The centralized coded caching framework, consists of a caching phase and a delivery phase, both of which are carefully designed in order to use the cache and the channel together optimally. In prior literature, various combinatorial structures have been used to construct coded caching schemes. One of the chief drawbacks of many of these existing constructions is the large subpacketization level, which denotes the number of times a file should be split for the schemes to provide coding gain. In this work, using a new binary matrix model, we present several novel constructions for coded caching based on the various types of combinatorial designs and their $q$-analogs, which are also called subspace designs. While most of the schemes constructed in this work (based on existing designs) have a high cache requirement, they provide a rate that is either constant or decreasing, and moreover require competitively small levels of subpacketization, which is an extremely important feature in practical applications of coded caching. We also apply our constructions to the distributed computing framework of MapReduce, which consists of three phases, the Map phase, the Shuffle phase and the Reduce phase. Using our binary matrix framework, we present a new simple generic coded data shuffling scheme. Employing our designs-based constructions in conjunction with this new shuffling scheme, we obtain new coded computing schemes which have low file complexity, with marginally higher communication load compared to the optimal scheme for equivalent parameters. We show that our schemes can neatly extend to the scenario with full and partial stragglers also.


title: OSRT: Omnidirectional Image Super-Resolution with Distortion-aware Transformer

abstract: Omnidirectional images (ODIs) have obtained lots of research interest for immersive experiences. Although ODIs require extremely high resolution to capture details of the entire scene, the resolutions of most ODIs are insufficient. Previous methods attempt to solve this issue by image super-resolution (SR) on equirectangular projection (ERP) images. However, they omit geometric properties of ERP in the degradation process, and their models can hardly generalize to real ERP images. In this paper, we propose Fisheye downsampling, which mimics the real-world imaging process and synthesizes more realistic low-resolution samples. Then we design a distortion-aware Transformer (OSRT) to modulate ERP distortions continuously and self-adaptively. Without a cumbersome process, OSRT outperforms previous methods by about 0.2dB on PSNR. Moreover, we propose a convenient data augmentation strategy, which synthesizes pseudo ERP images from plain images. This simple strategy can alleviate the over-fitting problem of large networks and significantly boost the performance of ODISR. Extensive experiments have demonstrated the state-of-the-art performance of our OSRT. Codes and models will be available at https://github.com/Fanghua-Yu/OSRT.


title: p-Adic sigma functions and heights on Jacobians of genus 2 curves

abstract: Let $C$ be a genus $2$ hyperelliptic curve over a number field $K$, with a Weierstrass point $\infty$ at infinity, let $J$ be its Jacobian, let $\Theta$ be the theta divisor with respect to $\infty$, and let $p$ be any prime number. We give an explicit construction of a $p$-adic height $h_p\colon J(\overline{\mathbb{Q}})\to \mathbb{Q}_p$ by means of $p$-adic analogues of N\'eron functions of divisor $2\Theta$. We define such N\'eron functions using division polynomials and a generalisation of Blakestad's $p$-adic sigma function on the formal group of $J$. We prove that our $p$-adic N\'eron function $\lambda_v$ at a non-archimedean place $v$ of $K$ is the image, under a suitable trace map, of a symmetric $v$-adic Green function of divisor $\Theta$ \`a la Colmez. We use this to relate $\lambda_v$ and $h_p$ to local and global extended Coleman-Gross (and hence Nekov\'a\v{r}) $p$-adic height pairings. We provide examples of our implementation, including one for a prime $p$ greater than $10^6$, and explain how similar techniques can be used to compute $p$-adic integrals of differentials of the first, second and third kind on $C$ independently of the reduction type. As an application, we also give an explicit quadratic Chabauty function vanishing on the rational points on certain genus $4$ bihyperelliptic curves.


title: Cepheid metallicity in the Leavitt law (C-MetaLL) survey -- III. Simultaneous derivation of the Gaia parallax offset and Period-Luminosity-Metallicity coefficients

abstract: Classical Cepheids (DCEPs) are the most important standard candles in the extra-galactic distance scale thanks to the Period-Luminosity ($\rm PL$), Period-Luminosity-Color ($\rm PLC$) and Period-Wesenheit ($\rm PW$) relations that hold for these objects. The advent of the {\it Gaia} mission, and in particular the Early Data Release 3 (EDR3) provided accurate parallaxes to calibrate these relations. In order to fully exploit {\it Gaia} measurements, the zero point (ZP) of {\it Gaia} parallaxes should be determined with an accuracy of a few $\rm \mu as$. The individual ZP corrections provided by the {\it Gaia} team depend on the magnitude and the position on the sky of the target. In this paper, we use an implicit method that relies on the Cepheid $\rm PL$ and $\rm PW$ relations to evaluate the ensemble {\it Gaia} parallax zero point. The best inferred estimation of the offset value needed to additionally correct (after the {\it Gaia} team correction) the {\it Gaia} parallaxes of the present DCEP sample, amounts to $\rm -22\pm 4\, \mu as$. This value is in agreement with the most recent literature values and confirms that the correction proposed by the {\it Gaia} team over-corrected the parallaxes.\\ As a further application of our results, we derive an estimate of the Large Magellanic Cloud distance ($\rm \mu_0=18.49\pm 0.06\, mag$), in very good agreement with the currently accepted value obtained through geometric methods.


title: 1-in-3 vs. Not-All-Equal: Dichotomy of a broken promise

abstract: The 1-in-3 and Not-All-Equal satisfiability problems for Boolean CNF formulas are two well-known NP-hard problems. In contrast, the promise 1-in-3 vs. Not-All-Equal problem can be solved in polynomial time. In the present work, we investigate this constraint satisfaction problem in a regime where the promise is weakened from either side by a rainbow-free structure, and establish a complexity dichotomy for the resulting class of computational problems.


title: Determination of the sound speed and an initial source in photoacoustic tomography

abstract: In thermoacoustic and photoacoustic tomography an electromagnetic wave is sent through a medium, heating it and therefore generating an elastic expansion that in turns generates an acoustic wave that is measured outside the medium. The general problem is to recover both the inhomogeneous sound speed and the initial pressure from the boundary measurements of the solution of the acoustic wave equation with a single measurement of the pressure. We show that one can recover both the sound speed and the initial pressure assuming a monocitiy condition on the sound speed that includes the physically interesting case of piecewise constant sound speeds. We also establish a link between this problem and the corresponding transmission eigenvalue problem.


title: Polyhedral Clinching Auctions with a Single Sample

abstract: In this study, we investigate auctions in two-sided markets with budget constraints on buyers. Our goal is to propose an efficient mechanism that satisfies dominant strategy incentive compatibility (DSIC), individual rationality (IR), and weak budget balance (WBB). To avoid several known impossibility theorems for each of two-sided markets and budget constraints, we assume prior information on sellers' valuations and investigate the efficiency of mechanisms by means of liquid welfare (LW), an efficiency measure used for budget-constrained auctions, in addition to social welfare (SW). Our first result is to improve the efficiency guarantees of the Polyhedral Clinching Auction by Hirai and Sato (2022), proposed for two-sided markets in which each seller is assumed to be truthful. We show that even under budget constraints and polymatroid constraints, their mechanism achieves an LW of more than 1/2 of the optimal LW, and an SW of more than the optimal LW. This significantly strengthens the efficiency guarantees of the existing studies on clinching auctions. Our second result is the extension of the Polyhedral Clinching Auction to a single-sample mechanism. Under the assumption that a single sample is provided from each seller's distribution on her valuation, we utilize the first result and propose an efficient mechanism that satisfies DSIC, IR, and WBB. Our mechanism achieves an LW of more than 1/4 of the optimal LW, and an SW of more than 1/2 of the optimal LW, in expectation. This result can be viewed as a budget extension of D"{u}tting et al. (2021).


title: On the relationship between multivariate splines and infinitely-wide neural networks

abstract: We consider multivariate splines and show that they have a random feature expansion as infinitely wide neural networks with one-hidden layer and a homogeneous activation function which is the power of the rectified linear unit. We show that the associated function space is a Sobolev space on a Euclidean ball, with an explicit bound on the norms of derivatives. This link provides a new random feature expansion for multivariate splines that allow efficient algorithms. This random feature expansion is numerically better behaved than usual random Fourier features, both in theory and practice. In particular, in dimension one, we compare the associated leverage scores to compare the two random expansions and show a better scaling for the neural network expansion.


title: Mind the Gap! Bridging Explainable Artificial Intelligence and Human Understanding with Luhmann's Functional Theory of Communication

abstract: Over the past decade explainable artificial intelligence has evolved from a predominantly technical discipline into a field that is deeply intertwined with social sciences. Insights such as human preference for contrastive -- more precisely, counterfactual -- explanations have played a major role in this transition, inspiring and guiding the research in computer science. Other observations, while equally important, have received much less attention. The desire of human explainees to communicate with artificial intelligence explainers through a dialogue-like interaction has been mostly neglected by the community. This poses many challenges for the effectiveness and widespread adoption of such technologies as delivering a single explanation optimised according to some predefined objectives may fail to engender understanding in its recipients and satisfy their unique needs given the diversity of human knowledge and intention. Using insights elaborated by Niklas Luhmann and, more recently, Elena Esposito we apply social systems theory to highlight challenges in explainable artificial intelligence and offer a path forward, striving to reinvigorate the technical research in this direction. This paper aims to demonstrate the potential of systems theoretical approaches to communication in understanding problems and limitations of explainable artificial intelligence.


title: Degree-3 Planar Graphs as Topological Minors of Wall Graphs in Polynomial Time

abstract: In this note, we give a proof of the fact that we can efficiently find degree-3 planar graphs as topological minors of sufficiently large wall graphs. The result is needed as an intermediate step to fix a proof in my PhD thesis.


title: Diverse Probabilistic Trajectory Forecasting with Admissibility Constraints

abstract: Predicting multiple trajectories for road users is important for automated driving systems: ego-vehicle motion planning indeed requires a clear view of the possible motions of the surrounding agents. However, the generative models used for multiple-trajectory forecasting suffer from a lack of diversity in their proposals. To avoid this form of collapse, we propose a novel method for structured prediction of diverse trajectories. To this end, we complement an underlying pretrained generative model with a diversity component, based on a determinantal point process (DPP). We balance and structure this diversity with the inclusion of knowledge-based quality constraints, independent from the underlying generative model. We combine these two novel components with a gating operation, ensuring that the predictions are both diverse and within the drivable area. We demonstrate on the nuScenes driving dataset the relevance of our compound approach, which yields significant improvements in the diversity and the quality of the generated trajectories.


title: The \theta-formulation of the 2D elastica -- Buckling and boundary layer theory

abstract: The equations of a planar elastica under pressure can be rewritten in a useful form by parametrising the variables in terms of the local orientation angle, $\theta$, instead of the arc length. This ``$\theta$-formulation'' lends itself to a particularly easy boundary layer analysis in the limit of weak bending stiffness. Within this parameterization, boundary layers are located at inflexion points, where $\theta$ is extremum, and they connect regions of low and large curvature. A simple composite solution is derived without resorting to elliptic functions and integrals. This approximation can be used as an elementary building block to describe complex shapes. Applying this theory to the study of an elastic ring under uniform pressure and subject to a set of point forces, we discover a snapping instability. This instability is confirmed by numerical simulations. Finally, we carry out experiments and find good agreement of the theory with the experimental shape of the deformed elastica.


title: Effect of ZrB$_2$ additions on the thermal stability of polycrystalline diamond

abstract: This study investigates the effect of ZrB$_2$ additions on the microstructure, thermal stability, and thermo-mechanical wear behaviour of polycrystalline diamond. Following high-pressure high-temperature (HPHT) sintering, the ZrB$_2$-PCD material showed a full conversion of the binder phase to cobalt-boride (Co2B and Co$_{23}$B$_6$) phases. In-situ PXRD and TEM vacuum annealing experiments observed that the onset of bulk graphitisation occurred above $1000^{\circ}C$ for the ZrB$_2$-PCD material, compared to $850^{\circ}C$ for the STD-PCD material. The ZrB$_2$-PCD tools showed excellent thermo-mechanical wear behaviour, exhibiting increased durability and a steady wear scar progression during high-temperature dry-VTL testing. However, lowered abrasion wear resistance was observed for the ZrB2-PCD tools during low-temperature wet-VTL testing, probably due the reduced diamond contiguity in the ZrB2 additive sample. Further optimisation of the ZrB$_2$ additive phase content, mixing methodology, or sintering conditions could be explored to improve the abrasive wear resistance of this novel PCD material.


title: Robustness Implies Fairness in Causal Algorithmic Recourse

abstract: Algorithmic recourse aims to disclose the inner workings of the black-box decision process in situations where decisions have significant consequences, by providing recommendations to empower beneficiaries to achieve a more favorable outcome. To ensure an effective remedy, suggested interventions must not only be low-cost but also robust and fair. This goal is accomplished by providing similar explanations to individuals who are alike. This study explores the concept of individual fairness and adversarial robustness in causal algorithmic recourse and addresses the challenge of achieving both. To resolve the challenges, we propose a new framework for defining adversarially robust recourse. The new setting views the protected feature as a pseudometric and demonstrates that individual fairness is a special case of adversarial robustness. Finally, we introduce the fair robust recourse problem to achieve both desirable properties and show how it can be satisfied both theoretically and empirically.


title: Stand Up Indulgent Gathering

abstract: We consider a swarm of mobile robots evolving in a bidimensional Euclidean space. We study a variant of the crash-tolerant gathering problem: if no robot crashes, robots have to meet at the same arbitrary location, not known beforehand, in finite time; if one or several robots crash at the same location, the remaining correct robots gather at the crash location to rescue them. Motivated by impossibility results in the semi-synchronous setting, we present the first solution to the problem for the fully synchronous setting that operates in the vanilla Look-Compute-Move model with no additional hypotheses: robots are oblivious, disoriented, have no multiplicity detection capacity, and may start from arbitrary positions (including those with multiplicity points). We furthermore show that robots gather in a time that is proportional to the initial maximum distance between robots.


title: $1/f^{3/2}$ noise in heavy traffic M/M/1 queue

abstract: We study the power spectral density of continuous time Markov chains and explicit its relationship with the eigenstructure of the infinitesimal generator. This result helps us understand the dynamics of the number of customers for a M/M/1 queuing process in the heavy traffic regime.Closed-form relations for the power law scalings associated to the eigenspectrum of the M/M/1 queue generator are obtained, providing a detailed description of the power spectral density structure, which is shown to exhibit a $1/f^{3/2}$ noise.We confirm this result by numerical simulation.We also show that a continuous time random walk on a ring exhibits very similar behavior.It is remarkable than a complex behavior such as $1/f$ noise can emerge from the M/M/1 queue, which is the ''simplest'' queuing model.


title: Effect of the N3LO three-nucleon contact interaction on p-d scattering observables

abstract: A unitary transformation allows to remove redundant terms in the two-nucleon (2N) contact interaction at the fourth order (N3LO) in the low-energy expansion of Chiral Effective Field Theory. In so doing a three-nucleon (3N) interaction is generated. We express its short-range component in terms of five combinations of low-energy constants (LECs) parametrizing the N3LO 2N contact Lagrangian. Within a hybrid approach, in which this interaction is considered in conjunction with the phenomenological AV18 2N potential, we show that the involved LECs can be used to fit very accurate data on polarization observables of low-energy $p-d$ scattering, in particular the $A_y$ asymmetry. The resulting interaction is of the right order of magnitude for a N3LO contribution.


title: Contradicting Motivations in Civic Tech Software Development: Analysis of a Grassroots Project

abstract: Grassroots civic tech, or software for social change, is an emerging practice where people create and then use software to create positive change in their community. In this interpretive case study, we apply Engestr\"om's expanded activity theory as a theoretical lens to analyze motivations, how they relate to for example group goals or development tool supported processes, and what contradictions emerge. Participants agreed on big picture motivations, such as learning new skills or improving the community. The main contradictions occurred inside activity systems on details of implementation or between system motives, instead of big picture motivations. Two most significant contradictions involved planning, and converging on design and technical approaches. These findings demonstrate the value of examining civic tech development processes as evolving activity systems.


title: Characterisation of Corrosion Damage in T91/F91 steel exposed to Liquid Lead-Bismuth Eutectic

abstract: T91 samples were exposed to static liquid lead-bismuth eutectic (LBE) at 700{\deg}C for 250-500 hours in either an oxidising or reducing environment. Corrosion damage was characterised using electron microscopy techniques, which identified networks of LBE intrusion beneath LBE-wetted surfaces. Under reducing conditions these networks are uniformly distributed, while they appear patchier and deeper under oxidising conditions. The individual intrusions preferentially follow microstructural features, initially along prior-austenite grain boundaries, followed by penetration down martensite lath boundaries. Local depletion of Cr was observed within 4 {\mu}m of the intrusions and along intersecting boundaries, suggesting local Cr dissolution as the main corrosion mechanism.


title: How a simple chloroplast psbA gene mutation changed world agriculture

abstract: Atrazine as a weed control tactic profoundly changed world agriculture. Long-term use revealed resistant biotypes, R, with a single base pair mutation of the chloroplast psbA gene. The R phenotype emerged from a sequential cascade of pleiotropic effects from the plastid to the whole plant. This reorganization of the R biotype revealed photosynthetic regulation at different levels of plant organization. The environment affected R plant productivity differently than in the susceptible, S, biotype. A consistent, differential, pattern of photosynthesis was observed between R and S over the diurnal light period. Photosynthetic superiority of a biotype was a function of the time of day, plant age temperature. Under highly favorable environmental conditions S often had the advantage over R. Under less favorable, stressful, conditions R can be at an advantage over S. Pleiotropic reorganization revealed a sun-air-leaf Shannon communication system, providing insights into the complex interaction of chloroplast components in photosynthetic regulation. Altered plastid thylakoid and stomatal function regulate how the R leaf utilizes the sun-air environment. Movement of sun-air messages demonstrated how sunlight and air are modified to a usable message for carbon fixation. These insights showed how agriculture changed weed populations, and how resistant weed populations changed agriculture. These changes changed herbicide resistance: introduction of herbicide resistant crops, HRC. The development of HRCs extended the evolutionary reach of R weeds. R weed biotypes were naturally selected in these introduced HRCs: an evolutionary spiral of human technology extended the phenotypic reach of R biotypes.


title: On the Theories Behind Hard Negative Sampling for Recommendation

abstract: Negative sampling has been heavily used to train recommender models on large-scale data, wherein sampling hard examples usually not only accelerates the convergence but also improves the model accuracy. Nevertheless, the reasons for the effectiveness of Hard Negative Sampling (HNS) have not been revealed yet. In this work, we fill the research gap by conducting thorough theoretical analyses on HNS. Firstly, we prove that employing HNS on the Bayesian Personalized Ranking (BPR) learner is equivalent to optimizing One-way Partial AUC (OPAUC). Concretely, the BPR equipped with Dynamic Negative Sampling (DNS) is an exact estimator, while with softmax-based sampling is a soft estimator. Secondly, we prove that OPAUC has a stronger connection with Top-K evaluation metrics than AUC and verify it with simulation experiments. These analyses establish the theoretical foundation of HNS in optimizing Top-K recommendation performance for the first time. On these bases, we offer two insightful guidelines for effective usage of HNS: 1) the sampling hardness should be controllable, e.g., via pre-defined hyper-parameters, to adapt to different Top-K metrics and datasets; 2) the smaller the $K$ we emphasize in Top-K evaluation metrics, the harder the negative samples we should draw. Extensive experiments on three real-world benchmarks verify the two guidelines.


title: Med-NCA: Robust and Lightweight Segmentation with Neural Cellular Automata

abstract: Access to the proper infrastructure is critical when performing medical image segmentation with Deep Learning. This requirement makes it difficult to run state-of-the-art segmentation models in resource-constrained scenarios like primary care facilities in rural areas and during crises. The recently emerging field of Neural Cellular Automata (NCA) has shown that locally interacting one-cell models can achieve competitive results in tasks such as image generation or segmentations in low-resolution inputs. However, they are constrained by high VRAM requirements and the difficulty of reaching convergence for high-resolution images. To counteract these limitations we propose Med-NCA, an end-to-end NCA training pipeline for high-resolution image segmentation. Our method follows a two-step process. Global knowledge is first communicated between cells across the downscaled image. Following that, patch-based segmentation is performed. Our proposed Med-NCA outperforms the classic UNet by 2% and 3% Dice for hippocampus and prostate segmentation, respectively, while also being 500 times smaller. We also show that Med-NCA is by design invariant with respect to image scale, shape and translation, experiencing only slight performance degradation even with strong shifts; and is robust against MRI acquisition artefacts. Med-NCA enables high-resolution medical image segmentation even on a Raspberry Pi B+, arguably the smallest device able to run PyTorch and that can be powered by a standard power bank.


title: MPC-based Motion Planning for Autonomous Truck-Trailer Maneuvering

abstract: Time-optimal motion planning of autonomous vehicles in complex environments is a highly researched topic. This paper describes a novel approach to optimize and execute locally feasible trajectories for the maneuvering of a truck-trailer Autonomous Mobile Robot (AMR), by dividing the environment in a sequence or route of freely accessible overlapping corridors. Multi-stage optimal control generates local trajectories through advancing subsets of this route. To cope with the advancing subsets and changing environments, the optimal control problem is solved online with a receding horizon in a Model Predictive Control (MPC) fashion with an improved update strategy. This strategy seamlessly integrates the computationally expensive MPC updates with a low-cost feedback controller for trajectory tracking, for disturbance rejection, and for stabilization of the unstable kinematics of the reversing truck-trailer AMR. This methodology is implemented in a flexible software framework for an effortless transition from offline simulations to deployment of experiments. An experimental setup showcasing the truck-trailer AMR performing two reverse parking maneuvers validates the presented method.


title: Entity-Aware Dual Co-Attention Network for Fake News Detection

abstract: Fake news and misinformation spread rapidly on the Internet. How to identify it and how to interpret the identification results have become important issues. In this paper, we propose a Dual Co-Attention Network (Dual-CAN) for fake news detection, which takes news content, social media replies, and external knowledge into consideration. Our experimental results support that the proposed Dual-CAN outperforms current representative models in two benchmark datasets. We further make in-depth discussions by comparing how models work in both datasets with empirical analysis of attention weights.


title: VertXNet: An Ensemble Method for Vertebrae Segmentation and Identification of Spinal X-Ray

abstract: Reliable vertebrae annotations are key to perform analysis of spinal X-ray images. However, obtaining annotation of vertebrae from those images is usually carried out manually due to its complexity (i.e. small structures with varying shape), making it a costly and tedious process. To accelerate this process, we proposed an ensemble pipeline, VertXNet, that combines two state-of-the-art (SOTA) segmentation models (respectively U-Net and Mask R-CNN) to automatically segment and label vertebrae in X-ray spinal images. Moreover, VertXNet introduces a rule-based approach that allows to robustly infer vertebrae labels (by locating the 'reference' vertebrae which are easier to segment than others) for a given spinal X-ray image. We evaluated the proposed pipeline on three spinal X-ray datasets (two internal and one publicly available), and compared against vertebrae annotated by radiologists. Our experimental results have shown that the proposed pipeline outperformed two SOTA segmentation models on our test dataset (MEASURE 1) with a mean Dice of 0.90, vs. a mean Dice of 0.73 for Mask R-CNN and 0.72 for U-Net. To further evaluate the generalization ability of VertXNet, the pre-trained pipeline was directly tested on two additional datasets (PREVENT and NHANES II) and consistent performance was observed with a mean Dice of 0.89 and 0.88, respectively. Overall, VertXNet demonstrated significantly improved performance for vertebra segmentation and labeling for spinal X-ray imaging, and evaluation on both in-house clinical trial data and publicly available data further proved its generalization.


title: Explainable Action Prediction through Self-Supervision on Scene Graphs

abstract: This work explores scene graphs as a distilled representation of high-level information for autonomous driving, applied to future driver-action prediction. Given the scarcity and strong imbalance of data samples, we propose a self-supervision pipeline to infer representative and well-separated embeddings. Key aspects are interpretability and explainability; as such, we embed in our architecture attention mechanisms that can create spatial and temporal heatmaps on the scene graphs. We evaluate our system on the ROAD dataset against a fully-supervised approach, showing the superiority of our training regime.


title: Universality Classes of Relativistic Fluid Dynamics: Foundations

abstract: A general organizing principle is proposed that can be used to derive the equations of motion describing the near-equilibrium dynamics of causal and thermodynamically stable relativistic systems. The latter are found to display some new type of universal behavior near equilibrium that allows them to be grouped into universality classes defined by their degrees of freedom, information content, and conservation laws. The universality classes expose a number of surprising equivalences between different theories, shedding new light on the near-equilibrium behavior of relativistic systems.


title: Optical bulk-boundary dichotomy in a quantum spin Hall insulator

abstract: The bulk-boundary correspondence is a key concept in topological quantum materials. For instance, a quantum spin Hall insulator features a bulk insulating gap with gapless helical boundary states protected by the underlying Z2 topology. However, the bulk-boundary dichotomy and distinction are rarely explored in optical experiments, which can provide unique information about topological charge carriers beyond transport and electronic spectroscopy techniques. Here, we utilize mid-infrared absorption micro-spectroscopy and pump-probe micro-spectroscopy to elucidate the bulk-boundary optical responses of Bi4Br4, a recently discovered room-temperature quantum spin Hall insulator. Benefiting from the low energy of infrared photons and the high spatial resolution, we unambiguously resolve a strong absorption from the boundary states while the bulk absorption is suppressed by its insulating gap. Moreover, the boundary absorption exhibits a strong polarization anisotropy, consistent with the one-dimensional nature of the topological boundary states. Our infrared pump-probe microscopy further measures a substantially increased carrier lifetime for the boundary states, which reaches one nanosecond scale. The nanosecond lifetime is about one to two orders longer than that of most topological materials and can be attributed to the linear dispersion nature of the helical boundary states. Our findings demonstrate the optical bulk-boundary dichotomy in a topological material and provide a proof-of-principal methodology for studying topological optoelectronics.


title: A Bayesian Optimization approach for calibrating large-scale activity-based transport models

abstract: The use of Agent-Based and Activity-Based modeling in transportation is rising due to the capability of addressing complex applications such as disruptive trends (e.g., remote working and automation) or the design and assessment of disaggregated management strategies. Still, the broad adoption of large-scale disaggregate models is not materializing due to the inherently high complexity and computational needs. Activity-based models focused on behavioral theory, for example, may involve hundreds of parameters that need to be calibrated to match the detailed socio-economical characteristics of the population for any case study. This paper tackles this issue by proposing a novel Bayesian Optimization approach incorporating a surrogate model in the form of an improved Random Forest, designed to automate the calibration process of the behavioral parameters. The proposed method is tested on a case study for the city of Tallinn, Estonia, where the model to be calibrated consists of 477 behavioral parameters, using the SimMobility MT software. Satisfactory performance is achieved in the major indicators defined for the calibration process: the error for the overall number of trips is equal to 4% and the average error in the OD matrix is 15.92 vehicles per day.


title: "I am the follower, also the boss": Exploring Different Levels of Autonomy and Machine Forms of Guiding Robots for the Visually Impaired

abstract: Guiding robots, in the form of canes or cars, have recently been explored to assist blind and low vision (BLV) people. Such robots can provide full or partial autonomy when guiding. However, the pros and cons of different forms and autonomy for guiding robots remain unknown. We sought to fill this gap. We designed autonomy-switchable guiding robotic cane and car. We conducted a controlled lab-study (N=12) and a field study (N=9) on BLV. Results showed that full autonomy received better walking performance and subjective ratings in the controlled study, whereas participants used more partial autonomy in the natural environment as demanding more control. Besides, the car robot has demonstrated abilities to provide a higher sense of safety and navigation efficiency compared with the cane robot. Our findings offered empirical evidence about how the BLV community perceived different machine forms and autonomy, which can inform the design of assistive robots.


title: Keeping Pace with Ever-Increasing Data: Towards Continual Learning of Code Intelligence Models

abstract: Previous research on code intelligence usually trains a deep learning model on a fixed dataset in an offline manner. However, in real-world scenarios, new code repositories emerge incessantly, and the carried new knowledge is beneficial for providing up-to-date code intelligence services to developers. In this paper, we aim at the following problem: How to enable code intelligence models to continually learn from ever-increasing data? One major challenge here is catastrophic forgetting, meaning that the model can easily forget knowledge learned from previous datasets when learning from the new dataset. To tackle this challenge, we propose REPEAT, a novel method for continual learning of code intelligence models. Specifically, REPEAT addresses the catastrophic forgetting problem with representative exemplars replay and adaptive parameter regularization. The representative exemplars replay component selects informative and diverse exemplars in each dataset and uses them to retrain model periodically. The adaptive parameter regularization component recognizes important parameters in the model and adaptively penalizes their changes to preserve the knowledge learned before. We evaluate the proposed approach on three code intelligence tasks including code summarization, software vulnerability detection, and code clone detection. Extensive experiments demonstrate that REPEAT consistently outperforms baseline methods on all tasks. For example, REPEAT improves the conventional fine-tuning method by 1.22, 5.61, and 1.72 on code summarization, vulnerability detection and clone detection, respectively.


title: On the hydrodynamics of hyperbolic liquid crystal elastomers

abstract: Liquid crystal elastomers are special cross-linked polymer materials combining the large elastic deformability of elastomers with the orientational orders of liquid crystals. This model exhibits markedly different phenomena than the liquid crystal model due to the strong coupling between mechanical elastic deformation and orientation vector. Our results are threefold. (i) First we derive the hydrodynamics of liquid crystal elastomers with inertial effect by energetic variational approach inspired by Chun Liu [33]. (ii) Then we study the hyperbolic liquid crystal elastomers from mathematical point, which is a fully quasilinear hyperbolic system. The local well-posedness for large data is proved by zero-viscosity limit method. (iii) Finally, we show the global regularity for small and smooth initial data near the constant equilibrium in three dimensions, which is achieved by carefully investigating the structure of second-order material derivatives and the cancellations in the system. This is the first global result on hyperbolic liquid crystal elastomers.


title: A proof of the union-closed sets conjecture

abstract: We provide a proof of the union-closed sets conjecture, by means of a suitable refinement of the breakthrough entropy-approach introduced by Gilmer. The novelty here is to consider a convex combination of $A$ and $A\cup B$, where $A,B$ are independent samples from the uniform distribution over a union-closed family.


title: SMEFT goes dark: Dark Matter models for four-fermion operators

abstract: We study ultra-violet completions for d = 6 four-fermion operators in the standard model effective field theory (SMEFT), focusing on models that contain cold dark matter candidates. Via a diagrammatic method, we generate systematically lists of possible UV completions, with the aim of providing sets of models, which are complete under certain, well specified assumptions. Within these lists of models we rediscover many known DM models, as diverse as R-parity conserving supersymmetry or the scotogenic neutrino mass model. Our lists, however, also contain many new constructions, which have not been studied in the literature so far. We also briefly discuss how our DM models could be constrained by reinterpretations of LHC searches and the prospects for HL-LHC and future lepton colliders.


title: Disk fragmentation around a massive protostar: a comparison of two three-dimensional codes

abstract: (Abridged) Most massive stars are located in multiple systems. The modeling of disk fragmentation, a possible mechanism leading to stellar multiplicity, relies on parallel 3D simulation codes whose agreement remains to be evaluated. Using the Cartesian AMR code RAMSES, we compare disk fragmentation in a centrally-condensed protostellar system to the study of Oliva & Kuiper (2020) performed on a grid in spherical coordinates using PLUTO. Two RAMSES runs are considered and give qualitatively distinct pictures. When allowing for unlimited sink particle creation, gas fragmentation leads to a multiple stellar system whose multiplicity is affected by the grid when triggering fragmentation and by numerically-assisted mergers. On the other hand, using a unique, central, fixed sink particle, a centrally-condensed system forms, similar to that reported in PLUTO. The RAMSES-PLUTO comparison is performed with the latter: agreement between the two codes is found regarding the first rotationally-supported disk formation, the presence of an accretion shock onto it, the first fragmentation phase. Gaseous fragments form and their properties are in agreement between the two codes. As a minor difference, fragments dynamics causes the disk structure to be sub-Keplerian in RAMSES whereas it is found to be Keplerian and reaches quiescence in PLUTO. We attribute this discrepancy to the central star being twice less massive in RAMSES because of the different stellar accretion subgrid models. In a centrally-condensed system, the agreement between RAMSES and PLUTO regarding many of the collapse properties and fragmentation process is good. Fragmentation occurring in the innermost region and numerical choices (use of sink particles, grid) have a crucial impact when similar but smooth initial conditions are employed - more crucial than the code's choice - on the system's outcome, multiple or centrally-condensed.

categories: astro-ph.SR astro-ph.EP astro-ph.GA astro-ph.IM


title: PIER: Permutation-Level Interest-Based End-to-End Re-ranking Framework in E-commerce

abstract: Re-ranking draws increased attention on both academics and industries, which rearranges the ranking list by modeling the mutual influence among items to better meet users' demands. Many existing re-ranking methods directly take the initial ranking list as input, and generate the optimal permutation through a well-designed context-wise model, which brings the evaluation-before-reranking problem. Meanwhile, evaluating all candidate permutations brings unacceptable computational costs in practice. Thus, to better balance efficiency and effectiveness, online systems usually use a two-stage architecture which uses some heuristic methods such as beam-search to generate a suitable amount of candidate permutations firstly, which are then fed into the evaluation model to get the optimal permutation. However, existing methods in both stages can be improved through the following aspects. As for generation stage, heuristic methods only use point-wise prediction scores and lack an effective judgment. As for evaluation stage, most existing context-wise evaluation models only consider the item context and lack more fine-grained feature context modeling. This paper presents a novel end-to-end re-ranking framework named PIER to tackle the above challenges which still follows the two-stage architecture and contains two mainly modules named FPSM and OCPM. We apply SimHash in FPSM to select top-K candidates from the full permutation based on user's permutation-level interest in an efficient way. Then we design a novel omnidirectional attention mechanism in OCPM to capture the context information in the permutation. Finally, we jointly train these two modules end-to-end by introducing a comparative learning loss. Offline experiment results demonstrate that PIER outperforms baseline models on both public and industrial datasets, and we have successfully deployed PIER on Meituan food delivery platform.


title: APAM: Adaptive Pre-training and Adaptive Meta Learning in Language Model for Noisy Labels and Long-tailed Learning

abstract: Practical natural language processing (NLP) tasks are commonly long-tailed with noisy labels. Those problems challenge the generalization and robustness of complex models such as Deep Neural Networks (DNNs). Some commonly used resampling techniques, such as oversampling or undersampling, could easily lead to overfitting. It is growing popular to learn the data weights leveraging a small amount of metadata. Besides, recent studies have shown the advantages of self-supervised pre-training, particularly to the under-represented data. In this work, we propose a general framework to handle the problem of both long-tail and noisy labels. The model is adapted to the domain of problems in a contrastive learning manner. The re-weighting module is a feed-forward network that learns explicit weighting functions and adapts weights according to metadata. The framework further adapts weights of terms in the loss function through a combination of the polynomial expansion of cross-entropy loss and focal loss. Our extensive experiments show that the proposed framework consistently outperforms baseline methods. Lastly, our sensitive analysis emphasizes the capability of the proposed framework to handle the long-tailed problem and mitigate the negative impact of noisy labels.


title: An elementary proof of Acerbi Fusco minimizer existence theorem

abstract: The weak lower semicontinuity of the functional $$ F(u)=\int_{\Omega}f(x,u,\nabla u)\, dx$$ is a classical topic that was studied thoroughly. It was shown that if the function $f$ is continuous and convex in the last variable, the functional is sequentially weakly lower semicontinuous on $W^{1,p}(\Omega)$. However, the known proofs use advanced instruments of real and functional analysis. Our aim here is to present proof that can be easily understood by students familiar only with the elementary measure theory.


title: Natural Language Processing for Policymaking

abstract: Language is the medium for many political activities, from campaigns to news reports. Natural language processing (NLP) uses computational tools to parse text into key information that is needed for policymaking. In this chapter, we introduce common methods of NLP, including text classification, topic modeling, event extraction, and text scaling. We then overview how these methods can be used for policymaking through four major applications including data collection for evidence-based policymaking, interpretation of political decisions, policy communication, and investigation of policy effects. Finally, we highlight some potential limitations and ethical concerns when using NLP for policymaking. This text is from Chapter 7 (pages 141-162) of the Handbook of Computational Social Science for Policy (2023). Open Access on Springer: https://doi.org/10.1007/978-3-031-16624-2


title: Learning Translation Quality Evaluation on Low Resource Languages from Large Language Models

abstract: Learned metrics such as BLEURT have in recent years become widely employed to evaluate the quality of machine translation systems. Training such metrics requires data which can be expensive and difficult to acquire, particularly for lower-resource languages. We show how knowledge can be distilled from Large Language Models (LLMs) to improve upon such learned metrics without requiring human annotators, by creating synthetic datasets which can be mixed into existing datasets, requiring only a corpus of text in the target language. We show that the performance of a BLEURT-like model on lower resource languages can be improved in this way.


title: Homological aspects of branching laws

abstract: In this mostly expository article, we consider certain homological aspects of branching laws for representations of a group restricted to its subgroups in the context of $p$-adic groups. We follow our earlier paper, ICM 2018 proceedings, updating it with some more recent works. In particular, following Chan and Chan-Savin, see many of their papers listed in the bibliography, we have emphasized in this work that the restriction of a (generic) representation $\pi$ of a group $G$ to a closed subgroup $H$ (most of the paper is written in the context of GGP) turns out to be a projective representation on most Bernstein blocks of the category of smooth representations of $H$. Further, once $\pi|_H$ is a projective module in a particular Bernstein block, it has a simple structure.


title: Revised Conditional t-SNE: Looking Beyond the Nearest Neighbors

abstract: Conditional t-SNE (ct-SNE) is a recent extension to t-SNE that allows removal of known cluster information from the embedding, to obtain a visualization revealing structure beyond label information. This is useful, for example, when one wants to factor out unwanted differences between a set of classes. We show that ct-SNE fails in many realistic settings, namely if the data is well clustered over the labels in the original high-dimensional space. We introduce a revised method by conditioning the high-dimensional similarities instead of the low-dimensional similarities and storing within- and across-label nearest neighbors separately. This also enables the use of recently proposed speedups for t-SNE, improving the scalability. From experiments on synthetic data, we find that our proposed method resolves the considered problems and improves the embedding quality. On real data containing batch effects, the expected improvement is not always there. We argue revised ct-SNE is preferable overall, given its improved scalability. The results also highlight new open questions, such as how to handle distance variations between clusters.


title: A Categorical Archive of ChatGPT Failures

abstract: Large language models have been demonstrated to be valuable in different fields. ChatGPT, developed by OpenAI, has been trained using massive amounts of data and simulates human conversation by comprehending context and generating appropriate responses. It has garnered significant attention due to its ability to effectively answer a broad range of human inquiries, with fluent and comprehensive answers surpassing prior public chatbots in both security and usefulness. However, a comprehensive analysis of ChatGPT's failures is lacking, which is the focus of this study. Eleven categories of failures, including reasoning, factual errors, math, coding, and bias, are presented and discussed. The risks, limitations, and societal implications of ChatGPT are also highlighted. The goal of this study is to assist researchers and developers in enhancing future language models and chatbots.


title: Can ChatGPT Write a Good Boolean Query for Systematic Review Literature Search?

abstract: Systematic reviews are comprehensive reviews of the literature for a highly focused research question. These reviews are often treated as the highest form of evidence in evidence-based medicine, and are the key strategy to answer research questions in the medical field. To create a high-quality systematic review, complex Boolean queries are often constructed to retrieve studies for the review topic. However, it often takes a long time for systematic review researchers to construct a high quality systematic review Boolean query, and often the resulting queries are far from effective. Poor queries may lead to biased or invalid reviews, because they missed to retrieve key evidence, or to extensive increase in review costs, because they retrieved too many irrelevant studies. Recent advances in Transformer-based generative models have shown great potential to effectively follow instructions from users and generate answers based on the instructions being made. In this paper, we investigate the effectiveness of the latest of such models, ChatGPT, in generating effective Boolean queries for systematic review literature search. Through a number of extensive experiments on standard test collections for the task, we find that ChatGPT is capable of generating queries that lead to high search precision, although trading-off this for recall. Overall, our study demonstrates the potential of ChatGPT in generating effective Boolean queries for systematic review literature search. The ability of ChatGPT to follow complex instructions and generate queries with high precision makes it a valuable tool for researchers conducting systematic reviews, particularly for rapid reviews where time is a constraint and often trading-off higher precision for lower recall is acceptable.


title: Sentiment Analysis on YouTube Smart Phone Unboxing Video Reviews in Sri Lanka

abstract: Product-related reviews are based on users' experiences that are mostly shared on videos in YouTube. It is the second most popular website globally in 2021. People prefer to watch videos on recently released products prior to purchasing, in order to gather overall feedback and make worthy decisions. These videos are created by vloggers who are enthusiastic about technical materials and feedback is usually placed by experienced users of the product or its brand. Analyzing the sentiment of the user reviews gives useful insights into the product in general. This study is focused on three smartphone reviews, namely, Apple iPhone 13, Google Pixel 6, and Samsung Galaxy S21 which were released in 2021. VADER, which is a lexicon and rule-based sentiment analysis tool was used to classify each comment to its appropriate positive or negative orientation. All three smartphones show a positive sentiment from the users' perspective and iPhone 13 has the highest number of positive reviews. The resulting models have been tested using N\"aive Bayes, Decision Tree, and Support Vector Machine. Among these three classifiers, Support Vector Machine shows higher accuracies and F1-scores.


title: MMRec: Simplifying Multimodal Recommendation

abstract: This paper presents an open-source toolbox, MMRec for multimodal recommendation. MMRec simplifies and canonicalizes the process of implementing and comparing multimodal recommendation models. The objective of MMRec is to provide a unified and configurable arena that can minimize the effort in implementing and testing multimodal recommendation models. It enables multimodal models, ranging from traditional matrix factorization to modern graph-based algorithms, capable of fusing information from multiple modalities simultaneously. Our documentation, examples, and source code are available at \url{https://github.com/enoche/MMRec}.


title: MAC: A unified framework boosting low resource automatic speech recognition

abstract: We propose a unified framework for low resource automatic speech recognition tasks named meta audio concatenation (MAC). It is easy to implement and can be carried out in extremely low resource environments. Mathematically, we give a clear description of MAC framework from the perspective of bayesian sampling. In this framework, we leverage a novel concatenative synthesis text-to-speech system to boost the low resource ASR task. By the concatenative synthesis text-to-speech system, we can integrate language pronunciation rules and adjust the TTS process. Furthermore, we propose a broad notion of meta audio set to meet the modeling needs of different languages and different scenes when using the system. Extensive experiments have demonstrated the great effectiveness of MAC on low resource ASR tasks. For CTC greedy search, CTC prefix, attention, and attention rescoring decode mode in Cantonese ASR task, Taiwanese ASR task, and Japanese ASR task the MAC method can reduce the CER by more than 15\%. Furthermore, in the ASR task, MAC beats wav2vec2 (with fine-tuning) on common voice datasets of Cantonese and gets really competitive results on common voice datasets of Taiwanese and Japanese. Among them, it is worth mentioning that we achieve a \textbf{10.9\%} character error rate (CER) on the common voice Cantonese ASR task, bringing about \textbf{30\%} relative improvement compared to the wav2vec2 (with fine-tuning).


title: Exploring Data Augmentation for Code Generation Tasks

abstract: Advances in natural language processing, such as transfer learning from pre-trained language models, have impacted how models are trained for programming language tasks too. Previous research primarily explored code pre-training and expanded it through multi-modality and multi-tasking, yet the data for downstream tasks remain modest in size. Focusing on data utilization for downstream tasks, we propose and adapt augmentation methods that yield consistent improvements in code translation and summarization by up to 6.9% and 7.5% respectively. Further analysis suggests that our methods work orthogonally and show benefits in output code style and numeric consistency. We also discuss test data imperfections.


title: Rotating Lifshitz-like black holes in F(R) gravity

abstract: Regarding a particular class of pure $F(R)$ gravity in three dimensions, we obtain an analytical rotating Lifshitz-like black hole solution. We first investigate some geometrical properties of the obtained solution that reduces to a charged rotating BTZ black hole in a special limit. Then, we study the optical features of such a black hole like the photon orbit and the energy emission rate and discuss how electric charge, angular momentum, and exponents affect them. In order to have an acceptable optical behavior, we should apply some constraints on the exponents. We continue our investigation with the study of the thermodynamic behavior of the solutions in the extended phase space and examine the validity of the first law of thermodynamics besides local thermal stability through using of heat capacity. Evaluating the existence of van der Waals-like phase transition, we obtain critical quantities and show how they change under the variation of black hole parameters. Finally, we construct a holographic heat engine of such a black hole and obtain its efficiency in a cycle. By comparing the obtained efficiency with the Carnot one, we examine the second law of thermodynamics.


title: Towards New Liquid Crystal Phases of DNA mesogens

abstract: Short, partially complementary, single-stranded (ss)DNA strands can form nanostructures with a wide variety of shapes and mechanical properties. It is well known that semiflexible, linear dsDNA can undergo an isotropic to nematic (IN) phase transition and that sufficiently bent structures can form a biaxial nematic phase. Here we use numerical simulations to explore how the phase behaviour of linear DNA constructs changes as we tune the mechanical properties of the constituent DNA by changing the nucleotide sequence. The IN phase transition can be suppressed in so-called DNA 'nunchakus': structures consisting of two rigid dsDNA arms, separated by a sufficiently flexible spacer. In this paper, we use simulations to explore what phase behavior to expect for different linear DNA constructs. To this end, we first performed numerical simulations exploring the structural properties of a number of different DNA oligonucleotides, using the oxDNA package. We then used the structural information generated in the oxDNA simulations to construct more coarse-grained models of the rodlike, bent-core, and nunchaku DNA. These coarse-grained models were used to explore the phase behavior of suspensions of the various DNA constructs. The approach explored in this paper makes it possible to 'design' the phase behavior of DNA constructs by a suitable choice of the constituent nucleotide sequence.


title: Determination of Local Short-Range Order in TiVNbHf(Al)

abstract: The presence of short-range chemical order can be a key factor in determining the mechanical behavior of metals, but directly and unambiguously determining its distribution in complex concentrated alloy systems can be challenging. Here, we directly identify and quantify chemical order in the globally single phase BCC-TiVNbHf(Al) system using aberration corrected scanning transmission electron microscopy (STEM) paired with spatial statistics methods. To overcome the difficulties of short-range order (SRO) quantification with STEM when the components of an alloy exhibit large atomic number differences and near equiatomic ratios, 'null hypothesis' tests are used to separate experiment from a random chemical distribution. Experiment is found to deviate from both the case of an ideal random solid solution and a fully ordered structure with statistical significance. We also identify local chemical order in TiVNbHf and confirm and quantify the enhancement of SRO with the addition of Al. These results provide insights into local chemical order in the promising TiVNbHf(Al) refractory alloys while highlighting the utility of spatial statistics in characterizing nanoscale SRO in compositionally complex systems.


title: Tool interoperability for model-based systems engineering

abstract: Supervisory control design of cyber-physical systems has many challenges. Model-based systems engineering can address these, with solutions originating from various disciplines. We discuss several tools, each state-of-the-art in its own discipline, offering functionality such as specification, synthesis, and verification. Integrating such mono-disciplinary tools in a multi-disciplinary workflow is a major challenge. We present Analytics as a Service, built on the Arrowhead framework, to connect these tools and make them interoperable. A seamless integration of the tools has been established through a service-oriented architecture: The engineer can easily access the functionality of the tools from a single interface, as translation steps between equivalent models for the respective tools are automated.


title: Learning to Predict Grip Quality from Simulation: Establishing a Digital Twin to Generate Simulated Data for a Grip Stability Metric

abstract: A robust grip is key to successful manipulation and joining of work pieces involved in any industrial assembly process. Stability of a grip depends on geometric and physical properties of the object as well as the gripper itself. Current state-of-the-art algorithms can usually predict if a grip would fail. However, they are not able to predict the force at which the gripped object starts to slip, which is critical as the object might be subjected to external forces, e.g. when joining it with another object. This research project aims to develop a AI-based approach for a grip metric based on tactile sensor data capturing the physical interactions between gripper and object. Thus, the maximum force that can be applied to the object before it begins to slip should be predicted before manipulating the object. The RGB image of the contact surface between the object and gripper jaws obtained from GelSight tactile sensors during the initial phase of the grip should serve as a training input for the grip metric. To generate such a data set, a pull experiment is designed using a UR 5 robot. Performing these experiments in real life to populate the data set is time consuming since different object classes, geometries, material properties and surface textures need to be considered to enhance the robustness of the prediction algorithm. Hence, a simulation model of the experimental setup has been developed to both speed up and automate the data generation process. In this paper, the design of this digital twin and the accuracy of the synthetic data are presented. State-of-the-art image comparison algorithms show that the simulated RGB images of the contact surface match the experimental data. In addition, the maximum pull forces can be reproduced for different object classes and grip scenarios. As a result, the synthetically generated data can be further used to train the neural grip metric network.


title: OPORP: One Permutation + One Random Projection

abstract: Consider two $D$-dimensional data vectors (e.g., embeddings): $u, v$. In many embedding-based retrieval (EBR) applications where the vectors are generated from trained models, $D=256\sim 1024$ are common. In this paper, OPORP (one permutation + one random projection) uses a variant of the ``count-sketch'' type of data structures for achieving data reduction/compression. With OPORP, we first apply a permutation on the data vectors. A random vector $r$ is generated i.i.d. with moments: $E(r_i) = 0, E(r_i^2)=1, E(r_i^3) =0, E(r_i^4)=s$. We multiply (as dot product) $r$ with all permuted data vectors. Then we break the $D$ columns into $k$ equal-length bins and aggregate (i.e., sum) the values in each bin to obtain $k$ samples from each data vector. One crucial step is to normalize the $k$ samples to the unit $l_2$ norm. We show that the estimation variance is essentially: $(s-1)A + \frac{D-k}{D-1}\frac{1}{k}\left[ (1-\rho^2)^2 -2A\right]$, where $A\geq 0$ is a function of the data ($u,v$). This formula reveals several key properties: (1) We need $s=1$. (2) The factor $\frac{D-k}{D-1}$ can be highly beneficial in reducing variances. (3) The term $\frac{1}{k}(1-\rho^2)^2$ is a substantial improvement compared with $\frac{1}{k}(1+\rho^2)$, which corresponds to the un-normalized estimator. We illustrate that by letting the $k$ in OPORP to be $k=1$ and repeat the procedure $m$ times, we exactly recover the work of ``very spars random projections'' (VSRP). This immediately leads to a normalized estimator for VSRP which substantially improves the original estimator of VSRP. In summary, with OPORP, the two key steps: (i) the normalization and (ii) the fixed-length binning scheme, have considerably improved the accuracy in estimating the cosine similarity, which is a routine (and crucial) task in modern embedding-based retrieval (EBR) applications.


title: Dynamic Training of Liquid State Machines

abstract: Spiking Neural Networks (SNNs) emerged as a promising solution in the field of Artificial Neural Networks (ANNs), attracting the attention of researchers due to their ability to mimic the human brain and process complex information with remarkable speed and accuracy. This research aimed to optimise the training process of Liquid State Machines (LSMs), a recurrent architecture of SNNs, by identifying the most effective weight range to be assigned in SNN to achieve the least difference between desired and actual output. The experimental results showed that by using spike metrics and a range of weights, the desired output and the actual output of spiking neurons could be effectively optimised, leading to improved performance of SNNs. The results were tested and confirmed using three different weight initialisation approaches, with the best results obtained using the Barabasi-Albert random graph method.


title: Meta-Learning Siamese Network for Few-Shot Text Classification

abstract: Few-shot learning has been used to tackle the problem of label scarcity in text classification, of which meta-learning based methods have shown to be effective, such as the prototypical networks (PROTO). Despite the success of PROTO, there still exist three main problems: (1) ignore the randomness of the sampled support sets when computing prototype vectors; (2) disregard the importance of labeled samples; (3) construct meta-tasks in a purely random manner. In this paper, we propose a Meta-Learning Siamese Network, namely, Meta-SN, to address these issues. Specifically, instead of computing prototype vectors from the sampled support sets, Meta-SN utilizes external knowledge (e.g. class names and descriptive texts) for class labels, which is encoded as the low-dimensional embeddings of prototype vectors. In addition, Meta-SN presents a novel sampling strategy for constructing meta-tasks, which gives higher sampling probabilities to hard-to-classify samples. Extensive experiments are conducted on six benchmark datasets to show the clear superiority of Meta-SN over other state-of-the-art models. For reproducibility, all the datasets and codes are provided at https://github.com/hccngu/Meta-SN.


title: Cluster-Level Contrastive Learning for Emotion Recognition in Conversations

abstract: A key challenge for Emotion Recognition in Conversations (ERC) is to distinguish semantically similar emotions. Some works utilise Supervised Contrastive Learning (SCL) which uses categorical emotion labels as supervision signals and contrasts in high-dimensional semantic space. However, categorical labels fail to provide quantitative information between emotions. ERC is also not equally dependent on all embedded features in the semantic space, which makes the high-dimensional SCL inefficient. To address these issues, we propose a novel low-dimensional Supervised Cluster-level Contrastive Learning (SCCL) method, which first reduces the high-dimensional SCL space to a three-dimensional affect representation space Valence-Arousal-Dominance (VAD), then performs cluster-level contrastive learning to incorporate measurable emotion prototypes. To help modelling the dialogue and enriching the context, we leverage the pre-trained knowledge adapters to infuse linguistic and factual knowledge. Experiments show that our method achieves new state-of-the-art results with 69.81% on IEMOCAP, 65.7% on MELD, and 62.51% on DailyDialog datasets. The analysis also proves that the VAD space is not only suitable for ERC but also interpretable, with VAD prototypes enhancing its performance and stabilising the training of SCCL. In addition, the pre-trained knowledge adapters benefit the performance of the utterance encoder and SCCL. Our code is available at: https://github.com/SteveKGYang/SCCL


title: Thermal fading of the $1/k^4$-tail of the momentum distribution induced by the hole anomaly

abstract: We study the thermal behavior of correlations in a one-dimensional Bose gas with tunable interaction strength, crossing from weakly-repulsive to Tonks-Girardeau regime. A reference temperature in this system is that of the hole anomaly, observed as a peak in the specific heat and a maximum in the chemical potential. We find that at large momenta $k$ and temperature above the anomaly threshold, the tail $\mathcal{C}/k^4$ of the momentum distribution (proportional to the Tan contact $\mathcal{C}$) is screened by the $1/|k|^3$-term due to a dramatic thermal increase of the internal energy emerging from the thermal occupation of spectral excitation states. The same fading is consistently revealed in the behavior at short distances $x$ of the one-body density matrix (OBDM) where the $|x|^3$-dependence disappears for temperatures above the anomaly. We obtain a new general analytic tail for the momentum distribution and a minimum $k$ fixing its validity range, both calculated with exact Bethe-Ansatz method and valid in all interaction and thermal regimes, crossing from the quantum to the classical gas limit. Our predictions are confirmed by comparison with ab-initio Path Integral Monte Carlo calculations for the momentum distribution and the OBDM exploring a wide range of interaction strength and temperature. Our results unveil a novel connection between excitations and correlations. We expect them to be of interest to any cold atomic, nuclear, solid-state, electronic and spin system exhibiting an anomaly or a thermal second-order phase transition.

categories: cond-mat.quant-gas cond-mat.other nucl-th physics.atom-ph physics.comp-ph


title: Quasi-steady-state air waveguide

abstract: We report the first generation of quasi-steady-state air waveguides capable of guiding high average power laser beams. The guides are produced by high-repetition rate patterned filamentation of femtosecond laser pulses. We demonstrate near-continuous guiding of a CW probe beam with significantly higher efficiency than transient guides at lower repetition rates.


title: Differential Privacy with Higher Utility by Exploiting Coordinate-wise Disparity: Laplace Mechanism can Beat Gaussian in High Dimensions

abstract: Conventionally, in a differentially private additive noise mechanism, independent and identically distributed (i.i.d.) noise samples are added to each coordinate of the response. In this work, we formally present the addition of noise which is independent, but not identically distributed (i.n.i.d.) across the coordinates to achieve tighter privacy-accuracy trade-off by exploiting coordinate-wise disparity. In particular, we study the i.n.i.d. Gaussian and Laplace mechanisms and obtain the conditions under which these mechanisms guarantee privacy. The optimal choice of parameters that ensure these conditions are derived theoretically. Theoretical analyses and numerical simulations demonstrate that the i.n.i.d. mechanisms achieve higher utility for the given privacy requirements compared to their i.i.d. counterparts. One of the interesting observations is that the Laplace mechanism outperforms Gaussian even in high dimensions, as opposed to the popular belief, if the irregularity in coordinate-wise sensitivities is exploited. We also demonstrate how the i.n.i.d. noise can improve the performance in the private empirical risk minimization through coordinate descent.


title: A Survey on Arabic Named Entity Recognition: Past, Recent Advances, and Future Trends

abstract: As more and more Arabic texts emerged on the Internet, extracting important information from these Arabic texts is especially useful. As a fundamental technology, Named entity recognition (NER) serves as the core component in information extraction technology, while also playing a critical role in many other Natural Language Processing (NLP) systems, such as question answering and knowledge graph building. In this paper, we provide a comprehensive review of the development of Arabic NER, especially the recent advances in deep learning and pre-trained language model. Specifically, we first introduce the background of Arabic NER, including the characteristics of Arabic and existing resources for Arabic NER. Then, we systematically review the development of Arabic NER methods. Traditional Arabic NER systems focus on feature engineering and designing domain-specific rules. In recent years, deep learning methods achieve significant progress by representing texts via continuous vector representations. With the growth of pre-trained language model, Arabic NER yields better performance. Finally, we conclude the method gap between Arabic NER and NER methods from other languages, which helps outline future directions for Arabic NER.


title: Rolle models in the real and complex world

abstract: Numerous problems of analysis (real and complex) and geometry (analytic, algebraic, Diophantine e.a.) can be reduced to calculation of the ``number of solutions'' of systems of equations, defined by algebraic equalities and differential equations with algebraic right hand sides (both ordinary and Pfaffian). In the purely algebraic context the paradigm is given by the B\'ezout theorem: the number of isolated solutions of a system of polynomial equations of degree $\le d$ in the $n$-dimensional space does not exceed $d^n$, the bound polynomial in $d$ and exponential in $n$. This bound is optimal: if we count solutions properly (i.e., with multiplicities, including complex solutions and solutions on the infinite hyperplane), then the equality holds. This paradigm can be generalized for the transcendental case as described above. It turns out some counting problems admit similar bounds depending only on the degrees and dimensions, whereas other can be treated only locally, i.e., admit bounds for the number of solutions in some domains of limited size. There is only one class of counting problems, which admits global bounds, but besides the degree and dimension, the answer depends on the height of the corresponding Pfaffian system. The unifying feature for these results is the core fact that lies at the heart of their proofs. This fact can be regarded as a variety of distant generalizations of the Rolle theorem known from the undergraduate calculus, claiming that between any two roots of a univariate differentiable function on a segment must lie a root of its derivative. We discuss generalizations of the Rolle theorem for vector-valued and complex analytic functions (none of them straightforward) and for germs of holomorphic maps.


title: Delayed Rabinowitz Floer Homology

abstract: In this article we study Rabinowitz Floer Homology for several interaction particles. In general Rabinowitz action functional is invariant under simultaneous time translation for all particles but not invariant if the times of each particle are translated individually. The delayed Rabinowitz action functional is invariant under individual time translation for each particle. Although its critical point equation looks like a Hamiltonian delay equation it is actually an ODE in disguise and nothing else than the critical point equation of the undelayed Rabinowitz action functional. We show that we can even interpolate between the two action functionals without changing the critical points and their actions. Moreover, for each of these interpolating action functionals we have compactness for gradient flow lines under a suitable restricted contact type assumption.


title: Comment on WKB series of all orders

abstract: The Dunham expansion for the one-dimensional two-turning-point eigenvalue problem for all orders in the WKB approximation is examined. An explicit form for all the odd order terms in the expansion which are are total derivatives is given.


title: Polynomial propagators for classical molecular dynamics

abstract: Classical molecular dynamics simulation is performed mostly using the established velocity Verlet integrator or other symplectic propagation schemes. In this work, an alternative formulation of numerical propagators for classical molecular dynamics is introduced based on an expansion of the time evolution operator in series of Chebyshev and Newton polynomials. The suggested propagators have, in principle, arbitrary order of accuracy which can be controlled by the choice of expansion order after that the series is truncated. However, the expansion converges only after a minimum number of terms is included in the expansion and this number increases linearly with the time step size. Measurements of the energy drift demonstrate the acceptable long-time stability of the polynomial propagators. It is shown that a system of interacting Lennard-Jones particles is tractable by the proposed technique and that the scaling with the expansion order is only polynomial while the scaling with the number of particles is the same as with the conventional velocity Verlet. The proposed method is, in principle, extendable for further interaction force fields and for integration with a thermostat, and can be parallelized to speed up the computation of every time step.


title: Optimization of Topology-Aware Job Allocation on a High-Performance Computing Cluster by Neural Simulated Annealing

abstract: Jobs on high-performance computing (HPC) clusters can suffer significant performance degradation due to inter-job network interference. Topology-aware job allocation problem (TJAP) is such a problem that decides how to dedicate nodes to specific applications to mitigate inter-job network interference. In this paper, we study the window-based TJAP on a fat-tree network aiming at minimizing the cost of communication hop, a defined inter-job interference metric. The window-based approach for scheduling repeats periodically taking the jobs in the queue and solving an assignment problem that maps jobs to the available nodes. Two special allocation strategies are considered, i.e., static continuity assignment strategy (SCAS) and dynamic continuity assignment strategy (DCAS). For the SCAS, a 0-1 integer programming is developed. For the DCAS, an approach called neural simulated algorithm (NSA), which is an extension to simulated algorithm (SA) that learns a repair operator and employs them in a guided heuristic search, is proposed. The efficacy of NSA is demonstrated with a computational study against SA and SCIP. The results of numerical experiments indicate that both the model and algorithm proposed in this paper are effective.


title: Argon milling induced decoherence mechanisms in superconducting quantum circuits

abstract: The fabrication of superconducting circuits requires multiple deposition, etch and cleaning steps, each possibly introducing material property changes and microscopic defects. In this work, we specifically investigate the process of argon milling, a potentially coherence limiting step, using niobium and aluminum superconducting resonators as a proxy for surface-limited behavior of qubits. We find that niobium microwave resonators exhibit an order of magnitude decrease in quality-factors after surface argon milling, while aluminum resonators are resilient to the same process. Extensive analysis of the niobium surface shows no change in the suboxide composition due to argon milling, while two-tone spectroscopy measurements reveal an increase in two-level system electrical dipole moments, indicating a structurally altered niobium oxide hosting larger two-level system defects. However, a short dry etch can fully recover the argon milling induced losses on niobium, offering a potential route towards state-of-the-art overlap Josephson junction qubits with niobium circuitry.


title: Efficient Parametric Approximations of Neural Network Function Space Distance

abstract: It is often useful to compactly summarize important properties of model parameters and training data so that they can be used later without storing and/or iterating over the entire dataset. As a specific case, we consider estimating the Function Space Distance (FSD) over a training set, i.e. the average discrepancy between the outputs of two neural networks. We propose a Linearized Activation Function TRick (LAFTR) and derive an efficient approximation to FSD for ReLU neural networks. The key idea is to approximate the architecture as a linear network with stochastic gating. Despite requiring only one parameter per unit of the network, our approach outcompetes other parametric approximations with larger memory requirements. Applied to continual learning, our parametric approximation is competitive with state-of-the-art nonparametric approximations, which require storing many training examples. Furthermore, we show its efficacy in estimating influence functions accurately and detecting mislabeled examples without expensive iterations over the entire dataset.


title: Strictly Frequentist Imprecise Probability

abstract: Strict frequentism defines probability as the limiting relative frequency in an infinite sequence. What if the limit does not exist? We present a broader theory, which is applicable also to random phenomena that exhibit diverging relative frequencies. In doing so, we develop a close connection with the theory of imprecise probability: the cluster points of relative frequencies yield a coherent upper prevision. We show that a natural frequentist definition of conditional probability recovers the generalized Bayes rule. This also suggests an independence concept, which is related to epistemic irrelevance in the imprecise probability literature. Finally, we prove constructively that, for a finite set of elementary events, there exists a sequence for which the cluster points of relative frequencies coincide with a prespecified set which demonstrates the naturalness, and arguably completeness, of our theory.


title: The Fourier, Hilbert and Mellin transforms on a half-line

abstract: We are interested in the singular behaviour at the origin of solutions to the equation $\mathscr{H} \rho = e$ on a half-axis, where $\mathscr H$ is the one-sided Hilbert transform, $\rho$ an unknown solution and $e$ a known function. This is a simpler model problem on the path to understanding wave field singularities caused by curve-shaped scatterers in a planar domain. We prove that $\rho$ has a singularity of the form $\mathscr M[e](1/2) / \sqrt{t}$ where $\mathscr M$ is the Mellin transform. To do this we use specially built function spaces $\mathscr M'(a,b)$ by Zemanian, and these allow us to precisely investigate the relationship between the Mellin and Hilbert transforms. Fourier comes into play in the sense that the Mellin transform is simpy the Fourier transform on the locally compact Abelian multiplicative group of the half-line, and as a more familiar operator it guides our investigation.


title: Systems of Precision: Coherent Probabilities on Pre-Dynkin-Systems and Coherent Previsions on Linear Subspaces

abstract: In literature on imprecise probability little attention is paid to the fact that imprecise probabilities are precise on a set of events. We call these sets systems of precision. We show that, under mild assumptions, the system of precision of a lower and upper probability form a so-called (pre-)Dynkin-system. Interestingly, there are several settings, ranging from machine learning on partial data over frequential probability theory to quantum probability theory and decision making under uncertainty, in which a priori the probabilities are only desired to be precise on a specific underlying set system. Here, (pre-)Dynkin-systems have been adopted as systems of precision, too. We show that, under extendability conditions, those pre-Dynkin-systems equipped with probabilities can be embedded into algebras of sets. Surprisingly, the extendability conditions elaborated in a strand of work in quantum probability are equivalent to coherence from the imprecise probability literature. On this basis, we spell out a lattice duality which relates systems of precision to credal sets of probabilities. We conclude the presentation with a generalization of the framework to expectation-type counterparts of imprecise probabilities. The analogue of pre-Dynkin-systems turn out to be (sets of) linear subspaces in the space of bounded, real-valued functions. We introduce partial expectations, natural generalizations of probabilities defined on pre-Dynkin-systems. Again, coherence and extendability are equivalent. A related, but more general lattice duality preserves the relation between systems of precision and credal sets of probabilities.


title: Sparse Mixture Once-for-all Adversarial Training for Efficient In-Situ Trade-Off Between Accuracy and Robustness of DNNs

abstract: Existing deep neural networks (DNNs) that achieve state-of-the-art (SOTA) performance on both clean and adversarially-perturbed images rely on either activation or weight conditioned convolution operations. However, such conditional learning costs additional multiply-accumulate (MAC) or addition operations, increasing inference memory and compute costs. To that end, we present a sparse mixture once for all adversarial training (SMART), that allows a model to train once and then in-situ trade-off between accuracy and robustness, that too at a reduced compute and parameter overhead. In particular, SMART develops two expert paths, for clean and adversarial images, respectively, that are then conditionally trained via respective dedicated sets of binary sparsity masks. Extensive evaluations on multiple image classification datasets across different models show SMART to have up to 2.72x fewer non-zero parameters costing proportional reduction in compute overhead, while yielding SOTA accuracy-robustness trade-off. Additionally, we present insightful observations in designing sparse masks to successfully condition on both clean and perturbed images.


title: Multiple Key-cast over Networks

abstract: The multicast key-dissemination problem over noiseless networks, introduced by Langberg and Effros [ITW 2022], here called the ``key-cast'' problem, captures the task of disseminating a shared secret random key to a set of terminals over a given network. Unlike traditional communication, where messages must be delivered from source to destination(s) unchanged, key-cast is more flexible since key-cast need not require source reconstruction at destination nodes. For example, the distributed keys can be mixtures of sources from which the sources themselves may be unrecoverable. The work at hand considers key dissemination in the single-source, multiple-multicast network coding setting, i.e., the ``multiple key-cast'' problem. Here, distinct keys are to be simultaneously transmitted from a single source node to multiple terminal sets, one shared random key per multicast set. Scenarios include the secure setting, in which only the source and intended destinations gain information about a given key; and the non-secure setting in which the only requirement is that the knowledge of one key does not reveal information about another. In both settings, we present combinatorial conditions for key dissemination and design corresponding multiple key-cast schemes. In addition, we compare the multiple key-cast rate with and without the restriction of source reconstruction, the former corresponding to traditional forms of communication; key-cast achieves a strict advantage in rate when source reconstruction is relaxed.


title: Multi-Task Deep Recommender Systems: A Survey

abstract: Multi-task learning (MTL) aims at learning related tasks in a unified model to achieve mutual improvement among tasks considering their shared knowledge. It is an important topic in recommendation due to the demand for multi-task prediction considering performance and efficiency. Although MTL has been well studied and developed, there is still a lack of systematic review in the recommendation community. To fill the gap, we provide a comprehensive review of existing multi-task deep recommender systems (MTDRS) in this survey. To be specific, the problem definition of MTDRS is first given, and it is compared with other related areas. Next, the development of MTDRS is depicted and the taxonomy is introduced from the task relation and methodology aspects. Specifically, the task relation is categorized into parallel, cascaded, and auxiliary with main, while the methodology is grouped into parameter sharing, optimization, and training mechanism. The survey concludes by summarizing the application and public datasets of MTDRS and highlighting the challenges and future directions of the field.


title: Magnetic Monopoles with No Strings Attached: A Portal to the Dark Side of Dual Electrodynamics

abstract: It has long been known that in the absence of electric charges and currents, Maxwell's electromagnetism in 4 dimensional vacuum Minkowski space-time is invariant under SO(2) dual transformations that mix its electric and magnetic fields. Extending this symmetry to include the coupling to electrically charged matter, requires a dual coupling to magnetically charged matter as well, leading to Maxwell equations for SO(2) dual electrodynamics. Based on a doubled ensemble of SO(2) dual 4-vector gauge potentials which does away with the need of Dirac string singularities for magnetic monopoles, a local Lagrangian action principle for SO(2) dual electromagnetism is known, which manifestly displays all the required space-time and internal symmetries, and reduces to the experimentally well established Maxwell electrodynamics in the absence of magnetic charges and currents. Applying the same considerations for the matter action of electrically and magnetically charged point particles, a unique SO(2) dual generalised Lorentz force is identified for SO(2) dual electrodynamics, truly different from the usual SO(2) dual invariant choice motivated by simplicity, but yet made arbitrarily and which does not derive from some action principle. This generalised Lorentz force involves a single real and new coupling constant of unknown value, without the requirement of a Dirac-Schwinger-Zwanziger quantisation condition for electric and magnetic charges of dyons. A physical consequence for SO(2) dual electrodynamics of this coupling constant if nonvanishing, is to open a channel, or portal between the otherwise mutually totally ``dark'' sectors of electric and magnetic charges for electromagnetic interactions.


title: First-Order Model Checking on Structurally Sparse Graph Classes

abstract: A class of graphs is structurally nowhere dense if it can be constructed from a nowhere dense class by a first-order transduction. Structurally nowhere dense classes vastly generalize nowhere dense classes and constitute important examples of monadically stable classes. We show that the first-order model checking problem is fixed-parameter tractable on every structurally nowhere dense class of graphs. Our result builds on a recently developed game-theoretic characterization of monadically stable graph classes. As a second key ingredient of independent interest, we provide a polynomial-time algorithm for approximating weak neighborhood covers (on general graphs). We combine the two tools into a recursive locality-based model checking algorithm. This algorithm is efficient on every monadically stable graph class admitting flip-closed sparse weak neighborhood covers, where flip-closure is a mild additional assumption. Thereby, establishing efficient first-order model checking on monadically stable classes is reduced to proving the existence of flip-closed sparse weak neighborhood covers on these classes - a purely combinatorial problem. We complete the picture by proving the existence of the desired covers for structurally nowhere dense classes: we show that every structurally nowhere dense class can be sparsified by contracting local sets of vertices, enabling us to lift the existence of covers from sparse classes.


title: Efficiently Upgrading Multilingual Machine Translation Models to Support More Languages

abstract: With multilingual machine translation (MMT) models continuing to grow in size and number of supported languages, it is natural to reuse and upgrade existing models to save computation as data becomes available in more languages. However, adding new languages requires updating the vocabulary, which complicates the reuse of embeddings. The question of how to reuse existing models while also making architectural changes to provide capacity for both old and new languages has also not been closely studied. In this work, we introduce three techniques that help speed up effective learning of the new languages and alleviate catastrophic forgetting despite vocabulary and architecture mismatches. Our results show that by (1) carefully initializing the network, (2) applying learning rate scaling, and (3) performing data up-sampling, it is possible to exceed the performance of a same-sized baseline model with 30% computation and recover the performance of a larger model trained from scratch with over 50% reduction in computation. Furthermore, our analysis reveals that the introduced techniques help learn the new directions more effectively and alleviate catastrophic forgetting at the same time. We hope our work will guide research into more efficient approaches to growing languages for these MMT models and ultimately maximize the reuse of existing models.


title: Comment on "Geometry of the quantum set on no-signaling faces"

abstract: In Ref. [1] the authors claim that the Almost Quantum set of correlations cannot reproduce two points on the boundary of the quantum set of correlations. This claim is incorrect. The underlying issue is that the associated SDP is not strictly feasible, which makes the numerical solvers give unreliable answers. We give analytical proofs that both points are indeed reproduced by Almost Quantum.


title: Understanding the Loss in Community Resilience due to Hurricanes using Facebook Data

abstract: Significant negative impacts are observed in productivity, economy, and social wellbeing because of the reduced human activity due to extreme events. Community resilience is an important and widely used concept to understand the impacts of an extreme event to population activity. Resilience is generally defined as the ability of a system to manage shocks and return to a steady state in response to an extreme event. In this study, aggregate location data from Facebook in response to Hurricane Ida are analyzed. Using changes in the number of Facebook users before, during, and after the disaster, community resilience is quantified as a function of the magnitude of impact and the time to recover from the extreme situation. Based on the resilience function, the transient loss of resilience in population activity is measured for the affected communities in Louisiana. The loss in resilience of the affected communities are explained by three types of factors, including disruption in physical infrastructures, disaster conditions due to hurricanes, and socio-economic characteristics. A greater loss in community resilience is associated with factors such as disruptions in power and transportation services and disaster conditions. Socioeconomic disparities in loss of resilience are found with respect to median income of a community. Understanding community resilience using decreased population activity levels due to a disaster and the factors associated with losses in resilience will enable us improve hazard preparedness, enhance disaster management practices, and create better recovery policies towards strengthening infrastructure and community resilience.