title: Holographic single particle imaging for weakly scattering, heterogeneous nanoscale objects

abstract: Single particle imaging (SPI) at X-ray free electron lasers (XFELs) is a technique to determine the 3D structure of nanoscale objects like biomolecules from a large number of diffraction patterns of copies of these objects in random orientations. Millions of low signal-to-noise diffraction patterns with unknown orientation are collected during an X-ray SPI experiment. The patterns are then analyzed and merged using a reconstruction algorithm to retrieve the full 3D-structure of particle. The resolution of reconstruction is limited by background noise, signal-to-noise ratio in diffraction patterns and total amount of data collected. We recently introduced a reference-enhanced holographic single particle imaging methodology [Optica 7,593-601(2020)] to collect high enough signal-to-noise and background tolerant patterns and a reconstruction algorithm to recover missing parameters beyond orientation and then directly retrieve the full Fourier model of the sample of interest. Here we describe a phase retrieval algorithm based on maximum likelihood estimation using pattern search dubbed as MaxLP, with better scalability for fine sampling of latent parameters and much better performance in the low signal limit. Furthermore, we show that structural variations within the target particle are averaged in real space, significantly improving robustness to conformational heterogeneity in comparison to conventional SPI. With these computational improvements, we believe reference-enhanced SPI is capable of reaching sub-nm resolution biomolecule imaging.


title: Refractory times for excitable dual state quantum dot laser neurons

abstract: Excitable photonic systems show promise for ultrafast analog computation, several orders of magnitude faster than biological neurons. Optically injected quantum dot lasers display several excitable mechanisms with dual state quantum lasers recently emerging as true all or none excitable artificial neurons. For use in applications, deterministic triggering is necessary and this has previously been demonstrated in the literature. In this work we analyse the crucially important \emph{refractory time} for this dual state system, which defines the minimum possible time between distinct pulses in any excitable pulse train. Ultrashort times on the order of 1~ns are obtained suggesting potential use where ultrafast analog computing is desired.


title: Integrated Decision and Control for High-Level Automated Vehicles by Mixed Policy Gradient and Its Experiment Verification

abstract: Self-evolution is indispensable to realize full autonomous driving. This paper presents a self-evolving decision-making system based on the Integrated Decision and Control (IDC), an advanced framework built on reinforcement learning (RL). First, an RL algorithm called constrained mixed policy gradient (CMPG) is proposed to consistently upgrade the driving policy of the IDC. It adapts the MPG under the penalty method so that it can solve constrained optimization problems using both the data and model. Second, an attention-based encoding (ABE) method is designed to tackle the state representation issue. It introduces an embedding network for feature extraction and a weighting network for feature fusion, fulfilling order-insensitive encoding and importance distinguishing of road users. Finally, by fusing CMPG and ABE, we develop the first data-driven decision and control system under the IDC architecture, and deploy the system on a fully-functional self-driving vehicle running in daily operation. Experiment results show that boosting by data, the system can achieve better driving ability over model-based methods. It also demonstrates safe, efficient and smart driving behavior in various complex scenes at a signalized intersection with real mixed traffic flow.


title: Accessing and Manipulating Dispersive Shock Waves in a Nonlinear and Nonlocal Rydberg Medium

abstract: Dispersive shock waves (DSWs) are fascinating wave phenomena occurring in media when nonlinearity overwhelms dispersion (or diffraction). Creating DSWs with low generation power and realizing their active controls is desirable but remains a longstanding challenge. Here, we propose a scheme to generate weak-light DSWs and realize their manipulations in an atomic gas involving strongly interacting Rydberg states under the condition of electromagnetically induced transparency (EIT). We show that for a two-dimensional (2D) Rydberg gas a weak nonlocality of optical Kerr nonlinearity can significantly change the edge speed of DSWs and induces a singular behavior of the edge speed and hence an instability of the DSWs. However, by increasing the degree of the Kerr nonlocality, the singular behavior of the edge speed and the instability of the DSWs can be suppressed. We also show that in a 3D Rydberg gas, DSWs can be created and propagate stably when the system works in the intermediate nonlocality regime. Due to the EIT effect and the giant nonlocal Kerr nonlinearity contributed by the Rydberg-Rydberg interaction, DSWs found here have extremely low generation power. In addition, an active control of DSWs can be realized; in particular, they can be stored and retrieved with high efficiency and fidelity through switching off and on a control laser field. The results reported here are useful not only for unveiling intriguing physics of DSWs but also for finding promising applications of nonlinear and nonlocal Rydberg media.


title: A Unified View of Masked Image Modeling

abstract: Masked image modeling has demonstrated great potential to eliminate the label-hungry problem of training large-scale vision Transformers, achieving impressive performance on various downstream tasks. In this work, we propose a unified view of masked image modeling after revisiting existing methods. Under the unified view, we introduce a simple yet effective method, termed as MaskDistill, which reconstructs normalized semantic features from teacher models at the masked positions, conditioning on corrupted input images. Experimental results on image classification and semantic segmentation show that MaskDistill achieves comparable or superior performance than state-of-the-art methods. When using the huge vision Transformer and pretraining 300 epochs, MaskDistill obtains 88.3% fine-tuning top-1 accuracy on ImageNet-1k (224 size) and 58.8% semantic segmentation mIoU metric on ADE20k (512 size). The code and pretrained models will be available at https://aka.ms/unimim.


title: Condensation temperature of strongly interacting $^{39}K$ condensates in the mean-field and semi-classical approximations

abstract: We consider the effect of inter-atom interactions on the condensation temperature $T_c$ of an atomic Bose-Einstein condensate. We find an analytic expression of the shift in $T_c$ induced by interactions with respect the ideal non-interacting case, in the mean-field and semi-classical approximations. Such a shift is expressed in terms of the ratio $a/\lambda_{T_c}$ between the s-wave scattering length $a$ and the thermal wavelength $\lambda_{T_c}$. This result is used to discuss the tension between mean-field predictions and observations in strongly interacting $^{39}K$ condensates. It is shown that such a tension is solved taking into account the details of the Feshbach resonance used to tune $a$ in the experiments.


title: A generalization of Ando's dilation, and isometric dilations for a class of tuples of $q$-commuting contractions

abstract: Given a bounded operator $Q$ on a Hilbert space $\mathcal{H}$, a pair of bounded operators $(T_1, T_2)$ on $\mathcal{H}$ is said to be $Q$-commuting if one of the following holds: \[ T_1T_2=QT_2T_1 \text{ or }T_1T_2=T_2QT_1 \text{ or }T_1T_2=T_2T_1Q. \] We give an explicit construction of isometric dilations for pairs of $Q$-commuting contractions for unitary $Q$, which generalizes the isometric dilation of Ando [2] for pairs of commuting contractions. In particular, for $Q=qI_{\mathcal{H}}$, where $q$ is a complex number of modulus $1$, this gives, as a corollary, an explicit construction of isometric dilations for pairs of $q$-commuting contractions which are well studied. There is an extended notion of $q$-commutativity for general tuples of operators and it is known that isometric dilation does not hold, in general, for an $n$-tuple of $q$-commuting contractions, where $n\geq 3$. Generalizing the class of commuting contractions considered by Brehmer [8], we construct a class of $n$-tuples of $q$-commuting contractions and find isometric dilations explicitly for the class.


title: Improving Chinese Story Generation via Awareness of Syntactic Dependencies and Semantics

abstract: Story generation aims to generate a long narrative conditioned on a given input. In spite of the success of prior works with the application of pre-trained models, current neural models for Chinese stories still struggle to generate high-quality long text narratives. We hypothesise that this stems from ambiguity in syntactically parsing the Chinese language, which does not have explicit delimiters for word segmentation. Consequently, neural models suffer from the inefficient capturing of features in Chinese narratives. In this paper, we present a new generation framework that enhances the feature capturing mechanism by informing the generation model of dependencies between words and additionally augmenting the semantic representation learning through synonym denoising training. We conduct a range of experiments, and the results demonstrate that our framework outperforms the state-of-the-art Chinese generation models on all evaluation metrics, demonstrating the benefits of enhanced dependency and semantic representation learning.


title: Restricted Bernoulli Matrix Factorization: Balancing the trade-off between prediction accuracy and coverage in classification based collaborative filtering

abstract: Reliability measures associated with the prediction of the machine learning models are critical to strengthening user confidence in artificial intelligence. Therefore, those models that are able to provide not only predictions, but also reliability, enjoy greater popularity. In the field of recommender systems, reliability is crucial, since users tend to prefer those recommendations that are sure to interest them, that is, high predictions with high reliabilities. In this paper, we propose Restricted Bernoulli Matrix Factorization (ResBeMF), a new algorithm aimed at enhancing the performance of classification-based collaborative filtering. The proposed model has been compared to other existing solutions in the literature in terms of prediction quality (Mean Absolute Error and accuracy scores), prediction quantity (coverage score) and recommendation quality (Mean Average Precision score). The experimental results demonstrate that the proposed model provides a good balance in terms of the quality measures used compared to other recommendation models.


title: Active Image Indexing

abstract: Image copy detection and retrieval from large databases leverage two components. First, a neural network maps an image to a vector representation, that is relatively robust to various transformations of the image. Second, an efficient but approximate similarity search algorithm trades scalability (size and speed) against quality of the search, thereby introducing a source of error. This paper improves the robustness of image copy detection with active indexing, that optimizes the interplay of these two components. We reduce the quantization loss of a given image representation by making imperceptible changes to the image before its release. The loss is back-propagated through the deep neural network back to the image, under perceptual constraints. These modifications make the image more retrievable. Our experiments show that the retrieval and copy detection of activated images is significantly improved. For instance, activation improves by $+40\%$ the Recall1@1 on various image transformations, and for several popular indexing structures based on product quantization and locality sensitivity hashing.


title: CLEAR: Causal Explanations from Attention in Neural Recommenders

abstract: We present CLEAR, a method for learning session-specific causal graphs, in the possible presence of latent confounders, from attention in pre-trained attention-based recommenders. These causal graphs describe user behavior, within the context captured by attention, and can provide a counterfactual explanation for a recommendation. In essence, these causal graphs allow answering "why" questions uniquely for any specific session. Using empirical evaluations we show that, compared to naively using attention weights to explain input-output relations, counterfactual explanations found by CLEAR are shorter and an alternative recommendation is ranked higher in the original top-k recommendations.


title: Exploration of M31 via Black-Hole Slingshots and the "Intergalactic Imperative"

abstract: I show that a gravitational slingshot using a stellar-mass black hole (BH) orbiting SgrA* could launch robotic spacecraft toward M31 at $0.1\,c$, a speed that is ultimately limited by the tensile strength of steel and the BH mass, here conservatively estimated as $m_{\rm bh}=5\,M_\odot$. The BH encounter must be accurate to $\lesssim 1\,$km, despite the fact that the BH is dark. Navigation guided by gravitational microlensing can easily achieve this. Deceleration into M31 would rely on a similar engagement (but in reverse) with an orbiting BH near the M31 center. Similarly for a return trip, if necessary. Colonization of M31 planets on 50 Myr timescales is therefore feasible provided that reconstruction of humans, trans-humans, or androids from digital data becomes feasible in the next few Myr. The implications for Fermi's Paradox (FP) are discussed. FP is restated in a more challenging form. The possibility of intergalactic colonization on timescales much shorter than the age of Earth significantly tightens FP. It can thereby impact our approach to astrobiology on few-decade timescales. I suggest using a network of tight white-dwarf-binary "hubs" as the backbone of a $0.002\,c$ intra-Galactic transport system, which would enable complete exploration of the Milky Way (hence full measurement of all non-zero terms in the Drake equation) on 10 Myr timescales. Such a survey would reveal the reality and/or severity of an "intergalactic imperative".

categories: physics.pop-ph astro-ph.EP astro-ph.GA astro-ph.IM astro-ph.SR physics.soc-ph


title: Names from Greek Myth in Fundamental Physics

abstract: Greek mythology supplies fundamental physics with the names of numerous (100+) experiments, machines, codes, and phenomena. I present the central narrative of Greek mythos via these names. Hyperlinks are provided for their physics counterparts, and the names are collected in myth- and physics-themed indices.

categories: physics.pop-ph hep-ex hep-ph physics.ed-ph


title: How Do the Probabilities Arise in Quantum Measurement?

abstract: A satisfactory resolution of the persistent quantum measurement problem remains stubbornly unresolved in spite of an overabundance of efforts of many prominent scientists over the decades. Among others, one key element is considered yet to be resolved. It comprises of where the probabilities of the measurement outcome stem from. This article attempts to provide a plausible answer to this enigma, thus eventually making progress toward a cogent solution of the longstanding measurement problem.


title: HyperMiner: Topic Taxonomy Mining with Hyperbolic Embedding

abstract: Embedded topic models are able to learn interpretable topics even with large and heavy-tailed vocabularies. However, they generally hold the Euclidean embedding space assumption, leading to a basic limitation in capturing hierarchical relations. To this end, we present a novel framework that introduces hyperbolic embeddings to represent words and topics. With the tree-likeness property of hyperbolic space, the underlying semantic hierarchy among words and topics can be better exploited to mine more interpretable topics. Furthermore, due to the superiority of hyperbolic geometry in representing hierarchical data, tree-structure knowledge can also be naturally injected to guide the learning of a topic hierarchy. Therefore, we further develop a regularization term based on the idea of contrastive learning to inject prior structural knowledge efficiently. Experiments on both topic taxonomy discovery and document representation demonstrate that the proposed framework achieves improved performance against existing embedded topic models.


title: HAVANA: Hard negAtiVe sAmples aware self-supervised coNtrastive leArning for Airborne laser scanning point clouds semantic segmentation

abstract: Deep Neural Network (DNN) based point cloud semantic segmentation has presented significant achievements on large-scale labeled aerial laser point cloud datasets. However, annotating such large-scaled point clouds is time-consuming. Due to density variations and spatial heterogeneity of the Airborne Laser Scanning (ALS) point clouds, DNNs lack generalization capability and thus lead to unpromising semantic segmentation, as the DNN trained in one region underperform when directly utilized in other regions. However, Self-Supervised Learning (SSL) is a promising way to solve this problem by pre-training a DNN model utilizing unlabeled samples followed by a fine-tuned downstream task involving very limited labels. Hence, this work proposes a hard-negative sample aware self-supervised contrastive learning method to pre-train the model for semantic segmentation. The traditional contrastive learning for point clouds selects the hardest negative samples by solely relying on the distance between the embedded features derived from the learning process, potentially evolving some negative samples from the same classes to reduce the contrastive learning effectiveness. Therefore, we design an AbsPAN (Absolute Positive And Negative samples) strategy based on k-means clustering to filter the possible false-negative samples. Experiments on two typical ALS benchmark datasets demonstrate that the proposed method is more appealing than supervised training schemes without pre-training. Especially when the labels are severely inadequate (10% of the ISPRS training set), the results obtained by the proposed HAVANA method still exceed 94% of the supervised paradigm performance with full training set.


title: Magnetic black holes in AdS space with nonlinear electrodynamics, extended phase space thermodynamics and Joule--Thomson expansion

abstract: Thermodynamics of magnetically charged black holes in Anti-de Sitter space in an extended phase space is studied. The cosmological constant is considered as a pressure and the black hole mass is treated as the chemical entalpy. The black hole thermodynamics is similar to the Van der Waals liquid-gas thermodynamics. Quantities conjugated to the nonlinear electrodynamics parameter and a magnetic charge are obtained. The first law of thermodynamics and the generalized Smarr relation take place. We investigate critical behavior of black holes and Joule--Thomson expansion. The Gibbs free energy, the Joule--Thomson coefficient and the inversion temperature are calculated.


title: RecipeMind: Guiding Ingredient Choices from Food Pairing to Recipe Completion using Cascaded Set Transformer

abstract: We propose a computational approach for recipe ideation, a downstream task that helps users select and gather ingredients for creating dishes. To perform this task, we developed RecipeMind, a food affinity score prediction model that quantifies the suitability of adding an ingredient to set of other ingredients. We constructed a large-scale dataset containing ingredient co-occurrence based scores to train and evaluate RecipeMind on food affinity score prediction. Deployed in recipe ideation, RecipeMind helps the user expand an initial set of ingredients by suggesting additional ingredients. Experiments and qualitative analysis show RecipeMind's potential in fulfilling its assistive role in cuisine domain.


title: Tenrec: A Large-scale Multipurpose Benchmark Dataset for Recommender Systems

abstract: Existing benchmark datasets for recommender systems (RS) either are created at a small scale or involve very limited forms of user feedback. RS models evaluated on such datasets often lack practical values for large-scale real-world applications. In this paper, we describe Tenrec, a novel and publicly available data collection for RS that records various user feedback from four different recommendation scenarios. To be specific, Tenrec has the following five characteristics: (1) it is large-scale, containing around 5 million users and 140 million interactions; (2) it has not only positive user feedback, but also true negative feedback (vs. one-class recommendation); (3) it contains overlapped users and items across four different scenarios; (4) it contains various types of user positive feedback, in forms of clicks, likes, shares, and follows, etc; (5) it contains additional features beyond the user IDs and item IDs. We verify Tenrec on ten diverse recommendation tasks by running several classical baseline models per task. Tenrec has the potential to become a useful benchmark dataset for a majority of popular recommendation tasks.


title: Irregularly-Sampled Time Series Modeling with Spline Networks

abstract: Observations made in continuous time are often irregular and contain the missing values across different channels. One approach to handle the missing data is imputing it using splines, by fitting the piecewise polynomials to the observed values. We propose using the splines as an input to a neural network, in particular, applying the transformations on the interpolating function directly, instead of sampling the points on a grid. To do that, we design the layers that can operate on splines and which are analogous to their discrete counterparts. This allows us to represent the irregular sequence compactly and use this representation in the downstream tasks such as classification and forecasting. Our model offers competitive performance compared to the existing methods both in terms of the accuracy and computation efficiency.


title: Simulated Contextual Bandits for Personalization Tasks from Recommendation Datasets

abstract: We propose a method for generating simulated contextual bandit environments for personalization tasks from recommendation datasets like MovieLens, Netflix, Last.fm, Million Song, etc. This allows for personalization environments to be developed based on real-life data to reflect the nuanced nature of real-world user interactions. The obtained environments can be used to develop methods for solving personalization tasks, algorithm benchmarking, model simulation, and more. We demonstrate our approach with numerical examples on MovieLens and IMDb datasets.


title: Electromagnetic Accelerating Universe

abstract: In recent work we have extended the theory that dark matter is composed of primordial black hole (PBHs) to extremely high masses and made an assumption that the holographic entropy bound is saturated. Astrophysicists have recently suggested that PBHs are formed with electric charges Q, retain their charges for the age of the universe, all charges have the same sign, and Q/M increases with mass M. Adopting these assumptions and using an approximate formula relating Q and M, it is here suggested that, for PBHs with over a trillion solar masses, Coulomb repulsion can exceed gravitational attraction and that electromagnetic properties of dark matter are a possible cause for the observed accelerated cosmological expansion.


title: Depth Contrast: Self-Supervised Pretraining on 3DPM Images for Mining Material Classification

abstract: This work presents a novel self-supervised representation learning method to learn efficient representations without labels on images from a 3DPM sensor (3-Dimensional Particle Measurement; estimates the particle size distribution of material) utilizing RGB images and depth maps of mining material on the conveyor belt. Human annotations for material categories on sensor-generated data are scarce and cost-intensive. Currently, representation learning without human annotations remains unexplored for mining materials and does not leverage on utilization of sensor-generated data. The proposed method, Depth Contrast, enables self-supervised learning of representations without labels on the 3DPM dataset by exploiting depth maps and inductive transfer. The proposed method outperforms material classification over ImageNet transfer learning performance in fully supervised learning settings and achieves an F1 score of 0.73. Further, The proposed method yields an F1 score of 0.65 with an 11% improvement over ImageNet transfer learning performance in a semi-supervised setting when only 20% of labels are used in fine-tuning. Finally, the Proposed method showcases improved performance generalization on linear evaluation. The implementation of proposed method is available on GitHub.


title: RankT5: Fine-Tuning T5 for Text Ranking with Ranking Losses

abstract: Recently, substantial progress has been made in text ranking based on pretrained language models such as BERT. However, there are limited studies on how to leverage more powerful sequence-to-sequence models such as T5. Existing attempts usually formulate text ranking as classification and rely on postprocessing to obtain a ranked list. In this paper, we propose RankT5 and study two T5-based ranking model structures, an encoder-decoder and an encoder-only one, so that they not only can directly output ranking scores for each query-document pair, but also can be fine-tuned with "pairwise" or "listwise" ranking losses to optimize ranking performances. Our experiments show that the proposed models with ranking losses can achieve substantial ranking performance gains on different public text ranking data sets. Moreover, when fine-tuned with listwise ranking losses, the ranking model appears to have better zero-shot ranking performance on out-of-domain data sets compared to the model fine-tuned with classification losses.


title: Nonlinear effects in Thomas precession due to the interplay of Lorentz contraction and Thomas--Wigner rotation

abstract: It is demonstrated that the 3--vector $\bs{S}$ currently associated to the spin in an inertial frame does not contract, but rather dilates, in the direction of the velocity. The correct vector $\bs{T}$ is individuated. The equation of motion for the two vectors is shown to contain two terms, a common linear rotation, identified with Thomas precession, and also a nonlinear rotation depending on the direction of the spin itself.


title: Using Interventions to Improve Out-of-Distribution Generalization of Text-Matching Recommendation Systems

abstract: Given a user's input text, text-matching recommender systems output relevant items by comparing the input text to available items' description, such as product-to-product recommendation on e-commerce platforms. As users' interests and item inventory are expected to change, it is important for a text-matching system to generalize to data shifts, a task known as out-of-distribution (OOD) generalization. However, we find that the popular approach of fine-tuning a large, base language model on paired item relevance data (e.g., user clicks) can be counter-productive for OOD generalization. For a product recommendation task, fine-tuning obtains worse accuracy than the base model when recommending items in a new category or for a future time period. To explain this generalization failure, we consider an intervention-based importance metric, which shows that a fine-tuned model captures spurious correlations and fails to learn the causal features that determine the relevance between any two text inputs. Moreover, standard methods for causal regularization do not apply in this setting, because unlike in images, there exist no universally spurious features in a text-matching task (the same token may be spurious or causal depending on the text it is being matched to). For OOD generalization on text inputs, therefore, we highlight a different goal: avoiding high importance scores for certain features. We do so using an intervention-based regularizer that constraints the causal effect of any token on the model's relevance score to be similar to the base model. Results on Amazon product and 3 question recommendation datasets show that our proposed regularizer improves generalization for both in-distribution and OOD evaluation, especially in difficult scenarios when the base model is not accurate.


title: Digital Asset Valuation: A Study on Domain Names, Email Addresses, and NFTs

abstract: Existing works on valuing digital assets on the Internet typically focus on a single asset class. To promote the development of automated valuation techniques, preferably those that are generally applicable to multiple asset classes, we construct DASH, the first Digital Asset Sales History dataset that features multiple digital asset classes spanning from classical to blockchain-based ones. Consisting of 280K transactions of domain names (DASH_DN), email addresses (DASH_EA), and non-fungible token (NFT)-based identifiers (DASH_NFT), such as Ethereum Name Service names, DASH advances the field in several aspects: the subsets DASH_DN, DASH_EA, and DASH_NFT are the largest freely accessible domain name transaction dataset, the only publicly available email address transaction dataset, and the first NFT transaction dataset that focuses on identifiers, respectively. We build strong conventional feature-based models as the baselines for DASH. We next explore deep learning models based on fine-tuning pre-trained language models, which have not yet been explored for digital asset valuation in the previous literature. We find that the vanilla fine-tuned model already performs reasonably well, outperforming all but the best-performing baselines. We further propose improvements to make the model more aware of the time sensitivity of transactions and the popularity of assets. Experimental results show that our improved model consistently outperforms all the other models across all asset classes on DASH.


title: Digital Human Interactive Recommendation Decision-Making Based on Reinforcement Learning

abstract: Digital human recommendation system has been developed to help customers find their favorite products and is playing an active role in various recommendation contexts. How to timely catch and learn the dynamics of the preferences of the customers, while meeting their exact requirements, becomes crucial in the digital human recommendation domain. We design a novel practical digital human interactive recommendation agent framework based on Reinforcement Learning(RL) to improve the efficiency of the interactive recommendation decision-making by leveraging both the digital human features and the superior flexibility of RL. Our proposed framework learns through real-time interactions between the digital human and customers dynamically through the state-of-art RL algorithms, combined with multimodal embedding and graph embedding, to improve the accuracy of personalization and thus enable the digital human agent to timely catch the attention of the customer. Experiments on real business data demonstrate that our framework can provide better personalized customer engagement and better customer experiences.


title: Robot Navigation with Reinforcement Learned Path Generation and Fine-Tuned Motion Control

abstract: In this paper, we propose a novel reinforcement learning (RL) based path generation (RL-PG) approach for mobile robot navigation without a prior exploration of an unknown environment. Multiple predictive path points are dynamically generated by a deep Markov model optimized using RL approach for robot to track. To ensure the safety when tracking the predictive points, the robot's motion is fine-tuned by a motion fine-tuning module. Such an approach, using the deep Markov model with RL algorithm for planning, focuses on the relationship between adjacent path points. We analyze the benefits that our proposed approach are more effective and are with higher success rate than RL-Based approach DWA-RL and a traditional navigation approach APF. We deploy our model on both simulation and physical platforms and demonstrate our model performs robot navigation effectively and safely.


title: The Commutator of the Bergman Projection on Strongly Pseudoconvex Domains with Minimal Smoothness

abstract: Consider a bounded, strongly pseudoconvex domain $D\subset \mathbb C^n$ with minimal smoothness (namely, the class $C^2$) and let $b$ be a locally integrable function on $D$. We characterize boundedness (resp., compactness) in $L^p(D), p > 1$, of the commutator $[b, P]$ of the Bergman projection $P$ in terms of an appropriate bounded (resp. vanishing) mean oscillation requirement on $b$. We also establish the equivalence of such notion of BMO (resp., VMO) with other BMO and VMO spaces given in the literature. Our proofs use a dyadic analog of the Berezin transform and holomorphic integral representations going back (for smooth domains) to N. Kerzman & E. M. Stein, and E. Ligocka.


title: Comparative analysis of deep learning approaches for AgNOR-stained cytology samples interpretation

abstract: Cervical cancer is a public health problem, where the treatment has a better chance of success if detected early. The analysis is a manual process which is subject to a human error, so this paper provides a way to analyze argyrophilic nucleolar organizer regions (AgNOR) stained slide using deep learning approaches. Also, this paper compares models for instance and semantic detection approaches. Our results show that the semantic segmentation using U-Net with ResNet-18 or ResNet-34 as the backbone have similar results, and the best model shows an IoU for nucleus, cluster, and satellites of 0.83, 0.92, and 0.99 respectively. For instance segmentation, the Mask R-CNN using ResNet-50 performs better in the visual inspection and has a 0.61 of the IoU metric. We conclude that the instance segmentation and semantic segmentation models can be used in combination to make a cascade model able to select a nucleus and subsequently segment the nucleus and its respective nucleolar organizer regions (NORs).


title: Public Good Provision with a Distributor

abstract: We present a model of public good provision with a distributor. Our main result describes a symmetric mixed-strategy equilibrium, where all agents contribute to a common fund with probability $p$ and the distributor provides either a particular amount of public goods or nothing. A corollary of this finding is the efficient public good provision equilibrium where all agents contribute to the common fund, all agents are expected to contribute, and the distributor spends the entire common fund for the public good provision.


title: Towards Accurate Subgraph Similarity Computation via Neural Graph Pruning

abstract: Subgraph similarity search, one of the core problems in graph search, concerns whether a target graph approximately contains a query graph. The problem is recently touched by neural methods. However, current neural methods do not consider pruning the target graph, though pruning is critically important in traditional calculations of subgraph similarities. One obstacle to applying pruning in neural methods is {the discrete property of pruning}. In this work, we convert graph pruning to a problem of node relabeling and then relax it to a differentiable problem. Based on this idea, we further design a novel neural network to approximate a type of subgraph distance: the subgraph edit distance (SED). {In particular, we construct the pruning component using a neural structure, and the entire model can be optimized end-to-end.} In the design of the model, we propose an attention mechanism to leverage the information about the query graph and guide the pruning of the target graph. Moreover, we develop a multi-head pruning strategy such that the model can better explore multiple ways of pruning the target graph. The proposed model establishes new state-of-the-art results across seven benchmark datasets. Extensive analysis of the model indicates that the proposed model can reasonably prune the target graph for SED computation. The implementation of our algorithm is released at our Github repo: https://github.com/tufts-ml/Prune4SED.


title: Transport Elliptical Slice Sampling

abstract: We propose a new framework for efficiently sampling from complex probability distributions using a combination of normalizing flows and elliptical slice sampling (Murray et al., 2010). The central idea is to learn a diffeomorphism, through normalizing flows, that maps the non-Gaussian structure of the target distribution to an approximately Gaussian distribution. We then use the elliptical slice sampler, an efficient and tuning-free Markov chain Monte Carlo (MCMC) algorithm, to sample from the transformed distribution. The samples are then pulled back using the inverse normalizing flow, yielding samples that approximate the stationary target distribution of interest. Our transport elliptical slice sampler (TESS) is optimized for modern computer architectures, where its adaptation mechanism utilizes parallel cores to rapidly run multiple Markov chains for a few iterations. Numerical demonstrations show that TESS produces Monte Carlo samples from the target distribution with lower autocorrelation compared to non-transformed samplers, and demonstrates significant improvements in efficiency when compared to gradient-based proposals designed for parallel computer architectures, given a flexible enough diffeomorphism.


title: Threefold enhancement of superconductivity and the role of field-induced odd-frequency pairing in epitaxial aluminum films near the 2D limit

abstract: BCS theory has been widely successful at describing elemental bulk superconductors. Yet, as the length scales of such superconductors approach the atomic limit, dimensionality as well as the environment of the superconductor can lead to drastically different and unpredictable superconducting behavior. Here, we report a threefold enhancement of the superconducting critical temperature and gap size in ultrathin epitaxial Al films on Si(111), when approaching the 2D limit, based on high-resolution scanning tunneling microscopy/spectroscopy (STM/STS) measurements. In magnetic field, the Al films show type II behavior and the Meservey-Tedrow-Fulde (MTF) effect for in-plane magnetic fields. Using spatially resolved spectroscopy, we characterize the vortex structure in the MTF regime and find strong deviations from the typical Abrikosov vortex. We corroborate these findings with calculations that unveil the role of odd-frequency pairing and a paramagnetic Meissner effect. These results illustrate two striking influences of reduced dimensionality on a BCS superconductor and present a new platform to study BCS superconductivity in large magnetic fields.


title: Robust Regression with Highly Corrupted Data via Physics Informed Neural Networks

abstract: Physics-informed neural networks (PINNs) have been proposed to solve two main classes of problems: data-driven solutions and data-driven discovery of partial differential equations. This task becomes prohibitive when such data is highly corrupted due to the possible sensor mechanism failing. We propose the Least Absolute Deviation based PINN (LAD-PINN) to reconstruct the solution and recover unknown parameters in PDEs - even if spurious data or outliers corrupt a large percentage of the observations. To further improve the accuracy of recovering hidden physics, the two-stage Median Absolute Deviation based PINN (MAD-PINN) is proposed, where LAD-PINN is employed as an outlier detector followed by MAD screening out the highly corrupted data. Then the vanilla PINN or its variants can be subsequently applied to exploit the remaining normal data. Through several examples, including Poisson's equation, wave equation, and steady or unsteady Navier-Stokes equations, we illustrate the generalizability, accuracy and efficiency of the proposed algorithms for recovering governing equations from noisy and highly corrupted measurement data.


title: Proposal of a dialogue system using Mecab

abstract: In recent years, artificial intelligence has developed in a variety of fields and is now integrated into many aspects of our daily lives. This includes AI speakers,communication robots, and other interactive systems. We are interested in AI speaker like systems in which the robot responds to the user's needs and speech synthesis. We participated in an interactive robot competition to promote the development of interactive robots.


title: Preliminary Analysis of Channel Capacity in Air to ground LoS MIMO Communication Based on A Cloud Modeling Method

abstract: Since the orthogonality of the line-of-sight multiple input multiple output (LoS MIMO) channel is only available within the Rayleigh distance, coverage of communication systems is restricted due to the finite implementation spacing of antennas. However, media with different permittivity in the transmission path are likely to loosen the requirement for antenna spacing. Such a conclusion could be enlightening in an air-to-ground LoS MIMO scenario considering the existence of clouds in the troposphere. To analyze the random phase variations in the presence of a single-layer cloud, we propose and modify a new cloud modeling method fit for LoS MIMO scene based on real-measurement data. Then, the preliminary analysis of channel capacity is conducted based on the simulation result.


title: Definition of the Tetrel Bond

abstract: This paper proposes a definition of the term "tetrel bond" based on the evidence documented in the current literature. It lists the donors, acceptors, as well as related characteristic features of tetrel bonds that are commonly observed in the crystalline phase and/or that emerge from first principles calculations in the solid-state and gas phases. These may be used to identify, char-acterize and classify the unique subset of inter- and intramolecular interactions formed by the elements of Group 14 of the Periodic Table that possess an electrophilic site in a molecular entity.


title: A Platform for Braiding Majorana Modes with Magnetic Skyrmions

abstract: After a decade of intense theoretical and experimental efforts, demonstrating braiding of Majorana modes remains an unsolved problem in condensed matter physics due to platform specific challenges. In this work, we propose topological superconductor -- magnetic multilayer heterostructures with on-chip microwave cavity readout as a novel platform for initializing, braiding and reading out Majorana modes. Stray fields from a skyrmion in the magnetic layers can nucleate a vortex in the topological superconducting layer. Such a vortex is known to host Majorana bound states at its core. Through analytical calculations within London and Thiele formalisms, and through micromagnetic simulations, we show that our nucleation and braiding scheme can be effectively realized with a variety of existing options for magnetic and superconducting layers. Further, we show that the coupling of the Majorana bound states to electric field of a resonator leads to an experimentally observable parity-dependent dispersive shift of the resonator frequency. Our work paves the way for realizing Majorana braiding in the near future.


title: Fant\^omas: Understanding Face Anonymization Reversibility

abstract: Face images are a rich source of information that can be used to identify individuals and infer private information about them. To mitigate this privacy risk, anonymizations employ transformations on clear images to obfuscate sensitive information, all while retaining some utility. Albeit published with impressive claims, they sometimes are not evaluated with convincing methodology. Reversing anonymized images to resemble their real input -- and even be identified by face recognition approaches -- represents the strongest indicator for flawed anonymization. Some recent results indeed indicate that this is possible for some approaches. It is, however, not well understood, which approaches are reversible, and why. In this paper, we provide an exhaustive investigation in the phenomenon of face anonymization reversibility. Among other things, we find that 11 out of 15 tested face anonymizations are at least partially reversible and highlight how both reconstruction and inversion are the underlying processes that make reversal possible.


title: Multi-Modal Recommendation System with Auxiliary Information

abstract: Context-aware recommendation systems improve upon classical recommender systems by including, in the modelling, a user's behaviour. Research into context-aware recommendation systems has previously only considered the sequential ordering of items as contextual information. However, there is a wealth of unexploited additional multi-modal information available in auxiliary knowledge related to items. This study extends the existing research by evaluating a multi-modal recommendation system that exploits the inclusion of comprehensive auxiliary knowledge related to an item. The empirical results explore extracting vector representations (embeddings) from unstructured and structured data using data2vec. The fused embeddings are then used to train several state-of-the-art transformer architectures for sequential user-item representations. The analysis of the experimental results shows a statistically significant improvement in prediction accuracy, which confirms the effectiveness of including auxiliary information in a context-aware recommendation system. We report a 4% and 11% increase in the NDCG score for long and short user sequence datasets, respectively.


title: Agile Systems Engineering for sub-CubeSat scale spacecraft

abstract: Space systems miniaturization has been increasingly popular for the past decades, with over 1600 CubeSats and 300 sub-CubeSat sized spacecraft estimated to have been launched since 1998. This trend towards decreasing size enables the execution of unprecedented missions in terms of quantity, cost and development time, allowing for massively distributed satellite networks, and rapid prototyping of space equipment. Pocket-sized spacecraft can be designed in-house in less than a year and can reach weights of less than 10g, reducing the considerable effort typically associated with orbital flight. However, while Systems Engineering methodologies have been proposed for missions down to CubeSat size, there is still a gap regarding design approaches for picosatellites and smaller spacecraft, which can exploit their potential for iterative and accelerated development. In this paper, we propose a Systems Engineering methodology that abstains from the classic waterfall-like approach in favor of agile practices, focusing on available capabilities, delivery of features and design "sprints". Our method, originating from the software engineering disciplines, allows quick adaptation to imposed constraints, changes to requirements and unexpected events (e.g. chip shortages or delays), by making the design flexible to well-defined modifications. Two femtosatellite missions, currently under development and due to be launched in 2023, are used as case studies for our approach, showing how miniature spacecraft can be designed, developed and qualified from scratch in 6 months or less. We claim that the proposed method can simultaneously increase confidence in the design and decrease turnaround time for extremely small satellites, allowing unprecedented missions to take shape without the overhead traditionally associated with sending cutting-edge hardware to space.


title: POGD: Gradient Descent with New Stochastic Rules

abstract: There introduce Particle Optimized Gradient Descent (POGD), an algorithm based on the gradient descent but integrates the particle swarm optimization (PSO) principle to achieve the iteration. From the experiments, this algorithm has adaptive learning ability. The experiments in this paper mainly focus on the training speed to reach the target value and the ability to prevent the local minimum. The experiments in this paper are achieved by the convolutional neural network (CNN) image classification on the MNIST and cifar-10 datasets.


title: Controlling Travel Path of Original Cobra

abstract: In this paper we propose a kernel based COBRA which is a direct approximation of the original COBRA. We propose a novel tuning procedure for original COBRA parameters based on this kernel approximation. We show that our proposed algorithm provides much better accuracy than other COBRAs and faster than usual Gridsearch COBRA. We use two datasets to illustrate our proposed methodology over existing COBRAs.


title: Galactic settlement of low-mass stars as a resolution to the Fermi paradox

abstract: An expanding civilization could rapidly spread through the galaxy, so the absence of extraterrestrial settlement in the solar system implies that such expansionist civilizations do not exist. This argument, often referred to as the Fermi paradox, typically assumes that expansion would proceed uniformly through the galaxy, but not all stellar types may be equally useful for a long-lived civilization. We suggest that low-mass stars, and K-dwarf stars in particular, would be ideal migration locations for civilizations that originate in a G-dwarf system. We use a modified form of the Drake Equation to show that expansion across all low-mass stars could be accomplished in 2 Gyr, which includes waiting time between expansion waves to allow for a close approach of a suitable destination star. This would require interstellar travel capabilities of no more than ~0.3 ly to settle all M-dwarfs and ~2 ly to settle all K-dwarfs. Even more rapid expansion could occur within 2 Myr, with travel requirements of ~10 ly to settle all M-dwarfs and ~50 ly to settle all K-dwarfs. The search for technosignatures in exoplanetary systems can help to place constraints on the presence of such a "low-mass Galactic Club" in the galaxy today.


title: A Framework for Undergraduate Data Collection Strategies for Student Support Recommendation Systems in Higher Education

abstract: Understanding which student support strategies mitigate dropout and improve student retention is an important part of modern higher educational research. One of the largest challenges institutions of higher learning currently face is the scalability of student support. Part of this is due to the shortage of staff addressing the needs of students, and the subsequent referral pathways associated to provide timeous student support strategies. This is further complicated by the difficulty of these referrals, especially as students are often faced with a combination of administrative, academic, social, and socio-economic challenges. A possible solution to this problem can be a combination of student outcome predictions and applying algorithmic recommender systems within the context of higher education. While much effort and detail has gone into the expansion of explaining algorithmic decision making in this context, there is still a need to develop data collection strategies Therefore, the purpose of this paper is to outline a data collection framework specific to recommender systems within this context in order to reduce collection biases, understand student characteristics, and find an ideal way to infer optimal influences on the student journey. If confirmation biases, challenges in data sparsity and the type of information to collect from students are not addressed, it will have detrimental effects on attempts to assess and evaluate the effects of these systems within higher education.


title: Barrow entropy and stochastic gravitational wave background generated from cosmological QCD phase transition

abstract: In this work we investigate the stochastic gravitational wave background generated during the f\/irst-order cosmological QCD phase transition of the early universe in the framework of the Barrow entropy. We f\/irst derived the Barrow corrections to the expression of stochastic gravitational wave background spectrum in presence of trace anomaly. Then, by taking account of Bubble wall collisions, sound waves and magnetohydrodynamic turbulence as the sources of stochastic gravitational wave, an analysis of the influence of Barrow entropy on the total energy density and the peak signal of stochastic gravitational wave signal is carried out. Finally, we discuss the possibility of detectors for the detection of these stochastic gravitational wave signals. Our results show that effect of Barrow entropy plays an important role in the temporal evolution of temperature of the universe as a function of the Hubble parameter, which leads to the signal of stochastic gravitational wave to shift towards the lower frequency regime, making the signal of stochastic gravitational wave possible to be probed by relevant ongoing and upcoming gravitational waves experiments.


title: Review of the state of the art in autonomous artificial intelligence

abstract: This article presents a new design for autonomous artificial intelligence (AI), based on the state-of-the-art algorithms, and describes a new autonomous AI system called AutoAI. The methodology is used to assemble the design founded on self-improved algorithms that use new and emerging sources of data (NEFD). The objective of the article is to conceptualise the design of a novel AutoAI algorithm. The conceptual approach is used to advance into building new and improved algorithms. The article integrates and consolidates the findings from existing literature and advances the AutoAI design into (1) using new and emerging sources of data for teaching and training AI algorithms and (2) enabling AI algorithms to use automated tools for training new and improved algorithms. This approach is going beyond the state-of-the-art in AI algorithms and suggests a design that enables autonomous algorithms to self-optimise and self-adapt, and on a higher level, be capable to self-procreate.


title: Binary Orthogonal Non-negative Matrix Factorization

abstract: We propose a method for computing binary orthogonal non-negative matrix factorization (BONMF) for clustering and classification. The method is tested on several representative real-world data sets. The numerical results confirm that the method has improved accuracy compared to the related techniques. The proposed method is fast for training and classification and space efficient.


title: Destructive Creation, Creative Destruction, and the Paradox of Innovation Science

abstract: Innovation or the creation and diffusion of new material, social and cultural things in society has been widely studied in sociology and across the social sciences, with investigations sufficiently diverse and dispersed to make them unnavigable. This complexity results from innovation's importance for society, but also the fundamental paradox underlying innovation science: When innovation becomes predictable, it ceases to be an engine of novelty and change. Here we review innovation studies and show that innovations emerge from contexts of discord and disorder, breaches in the structure of prior success, through a process we term destructive creation. This often leads to a complementary process of creative destruction whereby local structures protect and channel the diffusion of successful innovations, rendering alternatives obsolete. We find that social scientists naturally focus far more on how social and cultural contexts influence material innovations than the converse. We highlight computational tools that open new possibilities for the analysis of novel content and context in interaction, and show how this brings us empirically toward the broader range of possibilities that complex systems and science studies have theorized-and science fiction has imagined-the social, cultural and material structures of innovation conditioning each other's change through cycles of disruption and development.


title: Towards Practical Explainability with Cluster Descriptors

abstract: With the rapid development of machine learning, improving its explainability has become a crucial research goal. We study the problem of making the clusters more explainable by investigating the cluster descriptors. Given a set of objects $S$, a clustering of these objects $\pi$, and a set of tags $T$ that have not participated in the clustering algorithm. Each object in $S$ is associated with a subset of $T$. The goal is to find a representative set of tags for each cluster, referred to as the cluster descriptors, with the constraint that these descriptors we find are pairwise disjoint, and the total size of all the descriptors is minimized. In general, this problem is NP-hard. We propose a novel explainability model that reinforces the previous models in such a way that tags that do not contribute to explainability and do not sufficiently distinguish between clusters are not added to the optimal descriptors. The proposed model is formulated as a quadratic unconstrained binary optimization problem which makes it suitable for solving on modern optimization hardware accelerators. We experimentally demonstrate how a proposed explainability model can be solved on specialized hardware for accelerating combinatorial optimization, the Fujitsu Digital Annealer, and use real-life Twitter and PubMed datasets for use cases.


title: A Review of Data-Driven Discovery for Dynamic Systems

abstract: Many real-world scientific processes are governed by complex nonlinear dynamic systems that can be represented by differential equations. Recently, there has been increased interest in learning, or discovering, the forms of the equations driving these complex nonlinear dynamic system using data-driven approaches. In this paper we review the current literature on data-driven discovery for dynamic systems. We provide a categorization to the different approaches for data-driven discovery and a unified mathematical framework to show the relationship between the approaches. Importantly, we discuss the role of statistics in the data-driven discovery field, describe a possible approach by which the problem can be cast in a statistical framework, and provide avenues for future work.


title: Deep Multi-Representation Model for Click-Through Rate Prediction

abstract: Click-Through Rate prediction (CTR) is a crucial task in recommender systems, and it gained considerable attention in the past few years. The primary purpose of recent research emphasizes obtaining meaningful and powerful representations through mining low and high feature interactions using various components such as Deep Neural Networks (DNN), CrossNets, or transformer blocks. In this work, we propose the Deep Multi-Representation model (DeepMR) that jointly trains a mixture of two powerful feature representation learning components, namely DNNs and multi-head self-attentions. Furthermore, DeepMR integrates the novel residual with zero initialization (ReZero) connections to the DNN and the multi-head self-attention components for learning superior input representations. Experiments on three real-world datasets show that the proposed model significantly outperforms all state-of-the-art models in the task of click-through rate prediction.


title: Soil moisture estimation from Sentinel-1 interferometric observations over arid regions

abstract: We present a methodology based on interferometric synthetic aperture radar (InSAR) time series analysis that can provide surface (top 5 cm) soil moisture (SSM) estimations. The InSAR time series analysis consists of five processing steps. A co-registered Single Look Complex (SLC) SAR stack as well as meteorological information are required as input of the proposed workflow. In the first step, ice/snow-free and zero-precipitation SAR images are identified using meteorological data. In the second step, construction and phase extraction of distributed scatterers (DSs) (over bare land) is performed. In the third step, for each DS the ordering of surface soil moisture (SSM) levels of SAR acquisitions based on interferometric coherence is calculated. In the fourth step, for each DS the coherence due to SSM variations is calculated. In the fifth step, SSM is estimated by a constrained inversion of an analytical interferometric model using coherence and phase closure information. The implementation of the proposed approach is provided as an open-source software toolbox (INSAR4SM) available at www.github.com/kleok/INSAR4SM. A case study over an arid region in California/Arizona is presented. The proposed workflow was applied in Sentinel- 1 (C-band) VV-polarized InSAR observations. The estimated SSM results were assessed with independent SSM observations from a station of the International Soil Moisture Network (ISMN) (RMSE: 0.027 $m^3/m^3$ R: 0.88) and ERA5-Land reanalysis model data (RMSE: 0.035 $m^3/m^3$ R: 0.71). The proposed methodology was able to provide accurate SSM estimations at high spatial resolution (~250 m). A discussion of the benefits and the limitations of the proposed methodology highlighted the potential of interferometric observables for SSM estimation over arid regions.


title: Embedding a Critical Point in a Hadron to Quark-Gluon Crossover Equation of State

abstract: It is shown how to embed a critical point in a smooth background equation of state so as to yield the critical exponents and critical amplitude ratios expected of a transition in the same universality class as the liquid-gas phase transition and the 3D Ising model. There are only two independent critical exponents; the relations $\alpha + 2\beta + \gamma = 2$ and $\beta (\delta - 1) = \gamma$ arise automatically, as does a new relation between the two critical amplitudes. The resulting equation of state has parameters which may be inferred by hydrodynamic modeling of heavy ion collisions in the Beam Energy Scan II at the Relativistic Heavy Ion Collider.


title: Analysis of Master Vein Attacks on Finger Vein Recognition Systems

abstract: Finger vein recognition (FVR) systems have been commercially used, especially in ATMs, for customer verification. Thus, it is essential to measure their robustness against various attack methods, especially when a hand-crafted FVR system is used without any countermeasure methods. In this paper, we are the first in the literature to introduce master vein attacks in which we craft a vein-looking image so that it can falsely match with as many identities as possible by the FVR systems. We present two methods for generating master veins for use in attacking these systems. The first uses an adaptation of the latent variable evolution algorithm with a proposed generative model (a multi-stage combination of beta-VAE and WGAN-GP models). The second uses an adversarial machine learning attack method to attack a strong surrogate CNN-based recognition system. The two methods can be easily combined to boost their attack ability. Experimental results demonstrated that the proposed methods alone and together achieved false acceptance rates up to 73.29% and 88.79%, respectively, against Miura's hand-crafted FVR system. We also point out that Miura's system is easily compromised by non-vein-looking samples generated by a WGAN-GP model with false acceptance rates up to 94.21%. The results raise the alarm about the robustness of such systems and suggest that master vein attacks should be considered an important security measure.


title: N-Best Hypotheses Reranking for Text-To-SQL Systems

abstract: Text-to-SQL task maps natural language utterances to structured queries that can be issued to a database. State-of-the-art (SOTA) systems rely on finetuning large, pre-trained language models in conjunction with constrained decoding applying a SQL parser. On the well established Spider dataset, we begin with Oracle studies: specifically, choosing an Oracle hypothesis from a SOTA model's 10-best list, yields a $7.7\%$ absolute improvement in both exact match (EM) and execution (EX) accuracy, showing significant potential improvements with reranking. Identifying coherence and correctness as reranking approaches, we design a model generating a query plan and propose a heuristic schema linking algorithm. Combining both approaches, with T5-Large, we obtain a consistent $1\% $ improvement in EM accuracy, and a $~2.5\%$ improvement in EX, establishing a new SOTA for this task. Our comprehensive error studies on DEV data show the underlying difficulty in making progress on this task.


title: Weakly Supervised Learning for Analyzing Political Campaigns on Facebook

abstract: Social media platforms are currently the main channel for political messaging, allowing politicians to target specific demographics and adapt based on their reactions. However, making this communication transparent is challenging, as the messaging is tightly coupled with its intended audience and often echoed by multiple stakeholders interested in advancing specific policies. Our goal in this paper is to take a first step towards understanding these highly decentralized settings. We propose a weakly supervised approach to identify the stance and issue of political ads on Facebook and analyze how political campaigns use some kind of demographic targeting by location, gender, or age. Furthermore, we analyze the temporal dynamics of the political ads on election polls.


title: Attaining Class-level Forgetting in Pretrained Model using Few Samples

abstract: In order to address real-world problems, deep learning models are jointly trained on many classes. However, in the future, some classes may become restricted due to privacy/ethical concerns, and the restricted class knowledge has to be removed from the models that have been trained on them. The available data may also be limited due to privacy/ethical concerns, and re-training the model will not be possible. We propose a novel approach to address this problem without affecting the model's prediction power for the remaining classes. Our approach identifies the model parameters that are highly relevant to the restricted classes and removes the knowledge regarding the restricted classes from them using the limited available training data. Our approach is significantly faster and performs similar to the model re-trained on the complete data of the remaining classes.


title: High Energy Resummed Predictions for the Production of a Higgs Boson with at least One Jet

abstract: We present all-order predictions for Higgs boson production plus at least one jet which are accurate to leading logarithm in $\hat s/|p_\perp|^2$. Our calculation includes full top and bottom quark mass dependence at all orders in the logarithmic part, and to highest available order in the tree-level matching. The calculation is implemented in the framework of High Energy Jets (HEJ). This is the first cross section calculated with $\log(\hat s)$ resummation and matched to fixed order for a process requiring just one jet, and our results also extend the region of resummation for processes with two jets or more. This is possible because the resummation is performed explicitly in phase space. We compare the results of our new calculation to LHC data and to next-to-leading order predictions and find a numerically significant impact of the logarithmic corrections in the shape of key distributions, which remains after normalisation of the cross section.


title: Arabic Word-level Readability Visualization for Assisted Text Simplification

abstract: This demo paper presents a Google Docs add-on for automatic Arabic word-level readability visualization. The add-on includes a lemmatization component that is connected to a five-level readability lexicon and Arabic WordNet-based substitution suggestions. The add-on can be used for assessing the reading difficulty of a text and identifying difficult words as part of the task of manual text simplification. We make our add-on and its code publicly available.


title: The Possibility of Modeling the Very High Energy Afterglow of GRB 221009A in a Wind Environment

abstract: In this paper, we model the dynamics and radiation physics of the rarity event GRB 221009A afterglow in detail. By introducing a top-hat jet that propagates in an environment dominated by stellar winds, we explain the publicly available observations of afterglow associated with GRB 221009A over the first week. It is predicted that GRB 221009A emits a luminous very high energy (VHE) afterglow based on the synchrotron self-Compton (SSC) process in our model. We show the broadband spectral energy distribution (SED) analysis results of GRB 221009A, and find that the SSC radiation component of GRB 221009A is very bright in the 0.1 - 10 TeV band. The integrated SED shows that the SSC emission in the TeV band has significantly higher than the detection sensitivity of LHASSO, MAGIC and CTA. However, since the release of further observations, deviations from the standard wind environment model gradually show up in data. For example, the late-time multiband afterglow cannot be consistently explained under the standard wind environment scenario. It may be necessary to consider modeling with a structured jet with complex geometry or a partial revision of the standard model. Furthermore, we find that the inclusion of GeV observations could break the degeneracy between model parameters, highlighting the significance of high-energy observations in determining accurate parameters for GRB afterglows.


title: Odd-odd neutron-rich rhodium isotopes studied with the double Penning trap JYFLTRAP

abstract: Precision mass measurements of neutron-rich rhodium isotopes have been performed at the JYFLTRAP Penning trap mass spectrometer at the Ion Guide Isotope Separator On-Line (IGISOL) facility. We report results on ground- and isomeric-state masses in $^{110,112,114,116,118}$Rh and the very first mass measurement of $^{120}$Rh. The isomeric states were separated and measured for the first time using the phase-imaging ion-cyclotron-resonance (PI-ICR) technique. For $^{112}$Rh, we also report new half-lives for both the ground state and the isomer. The results are compared to theoretical predictions using the BSkG1 mass model and discussed in terms of triaxial deformation.


title: A search for kilonova radio flares in a sample of Swift/BAT short GRBs

abstract: The multi-messenger detection of GW170817 showed that binary neutron star (BNS) mergers are progenitors of (at least some) short gamma-ray bursts (GRBs), and that short GRB jets (and their afterglows) can have structures (and observational properties) more complex than predicted by the standard top-hat jet scenario. Indeed, the emission from the structured jet launched in GW170817 peaked in the radio band (cm wavelengths) at about 100 d since merger - a timescale much longer than the typical time span of radio follow-up observations of short GRBs. Moreover, radio searches for a potential late-time radio flare from the fast tail of the neutron-rich debris that powered the kilonova associated with GW170817 (AT2017gfo) have extended to even longer timescales (years after the merger). In light of this, here we present the results of an observational campaign targeting a sample of seven, years-old GRBs in the Swift/BAT sample with no redshift measurements and no promptly-identified X-ray counterpart. Our goal is to assess whether this sample of short GRBs could harbor nearby BNS mergers, searching for the late-time radio emission expected from their ejecta. We found one radio candidate counterpart for one of the GRBs in our sample, GRB111126A, though an origin related to emission from star formation or from an AGN in its host galaxy cannot be excluded without further observations.


title: Kirin: Hitting the Internet with Millions of Distributed IPv6 Announcements

abstract: The Internet is a critical resource in the day-to-day life of billions of users. To support the growing number of users and their increasing demands, operators have to continuously scale their network footprint -- e.g., by joining Internet Exchange Points -- and adopt relevant technologies -- such as IPv6. IPv6, however, has a vastly larger address space compared to its predecessor, which allows for new kinds of attacks on the Internet routing infrastructure. In this paper, we revisit prefix de-aggregation attacks in the light of these two changes and introduce Kirin -- an advanced BGP prefix de-aggregation attack that sources millions of IPv6 routes and distributes them via thousands of sessions across various IXPs to overflow the memory of border routers within thousands of remote ASes. Kirin's highly distributed nature allows it to bypass traditional route-flooding defense mechanisms, such as per-session prefix limits or route flap damping. We analyze the theoretical feasibility of the attack by formulating it as a Integer Linear Programming problem, test for practical hurdles by deploying the infrastructure required to perform a small-scale Kirin attack using 4 IXPs, and validate our assumptions via BGP data analysis, real-world measurements, and router testbed experiments. Despite its low deployment cost, we find Kirin capable of injecting lethal amounts of IPv6 routes in the routers of thousands of ASes.


title: List homomorphisms by deleting edges and vertices: tight complexity bounds for bounded-treewidth graphs

abstract: The goal of this paper is to investigate a family of optimization problems arising from list homomorphisms, and to understand what the best possible algorithms are if we restrict the problem to bounded-treewidth graphs. For a fixed $H$, the input of the optimization problem LHomVD($H$) is a graph $G$ with lists $L(v)$, and the task is to find a set $X$ of vertices having minimum size such that $(G-X,L)$ has a list homomorphism to $H$. We define analogously the edge-deletion variant LHomED($H$). This expressive family of problems includes members that are essentially equivalent to fundamental problems such as Vertex Cover, Max Cut, Odd Cycle Transversal, and Edge/Vertex Multiway Cut. For both variants, we first characterize those graphs $H$ that make the problem polynomial-time solvable and show that the problem is NP-hard for every other fixed $H$. Second, as our main result, we determine for every graph $H$ for which the problem is NP-hard, the smallest possible constant $c_H$ such that the problem can be solved in time $c^t_H\cdot n^{O(1)}$ if a tree decomposition of $G$ having width $t$ is given in the input.Let $i(H)$ be the maximum size of a set of vertices in $H$ that have pairwise incomparable neighborhoods. For the vertex-deletion variant LHomVD($H$), we show that the smallest possible constant is $i(H)+1$ for every $H$. The situation is more complex for the edge-deletion version. For every $H$, one can solve LHomED($H$) in time $i(H)^t\cdot n^{O(1)}$ if a tree decomposition of width $t$ is given. However, the existence of a specific type of decomposition of $H$ shows that there are graphs $H$ where LHomED($H$) can be solved significantly more efficiently and the best possible constant can be arbitrarily smaller than $i(H)$. Nevertheless, we determine this best possible constant and (assuming the SETH) prove tight bounds for every fixed $H$.


title: Towards Realistic Low-resource Relation Extraction: A Benchmark with Empirical Baseline Study

abstract: This paper presents an empirical study to build relation extraction systems in low-resource settings. Based upon recent pre-trained language models, we comprehensively investigate three schemes to evaluate the performance in low-resource settings: (i) different types of prompt-based methods with few-shot labeled data; (ii) diverse balancing methods to address the long-tailed distribution issue; (iii) data augmentation technologies and self-training to generate more labeled in-domain data. We create a benchmark with 8 relation extraction (RE) datasets covering different languages, domains and contexts and perform extensive comparisons over the proposed schemes with combinations. Our experiments illustrate: (i) Though prompt-based tuning is beneficial in low-resource RE, there is still much potential for improvement, especially in extracting relations from cross-sentence contexts with multiple relational triples; (ii) Balancing methods are not always helpful for RE with long-tailed distribution; (iii) Data augmentation complements existing baselines and can bring much performance gain, while self-training may not consistently achieve advancement to low-resource RE. Code and datasets are in https://github.com/zjunlp/LREBench.


title: Electronic and Excitonic Properties of MSi2Z4 Monolayers

abstract: MA2Z4 monolayers form a new class of hexagonal non-centrosymmetric materials hosting extraordinary spin-valley physics. While only two compounds (MoSi2N4 and WSi2N4) were recently synthesized, theory predicts interesting (opto)electronic properties of a whole new family of such two-dimensional materials. Here, the chemical trends of band gaps and spin-orbit splittings of bands in selected MSi2Z4 (M = Mo, W; Z = N, P, As, Sb) compounds are studied from first-principles. Effective Bethe-Salpeter-equation-based calculations reveal high exciton binding energies. Evolution of excitonic energies under external magnetic field is predicted by providing their effective g-factors and diamagnetic coefficients, which can be directly compared to experimental values. In particular, large positive g-factors are predicted for excitons involving higher conduction bands. In view of these predictions, MSi2Z4 monolayers yield a new platform to study excitons and are attractive for optoelectronic devices, also in the forms of heterostructures. In addition, a spin-orbit induced bands inversion is observed in the heaviest studied compound, WSi2Sb4, a hallmark of its topological nature.


title: Local sensing of absolute refractive index during protein-binding using microlasers with spectral encoding

abstract: Multiplexed, specific and sensitive detection of antigens is critical for the rapid and accurate diagnosis of disease and the informed development of personalized treatment plans. Here, we show that polymer microsphere lasers can be used as photonic sensors to monitor and quantify direct surface binding of biomolecules via changes in the refractive index. The unique spectral signature of each individual laser can be used to find their size and effective refractive index which adds a new encoding dimension when compared to conventional fluorescent beads. We utilize antibody-functionalized microlasers to selectively detect protein binding. Different stages of the multilayer surface modification can be resolved, and protein binding is demonstrated for two different proteins, IgG and CRP. Moreover, by continuously monitoring single lasers, we demonstrate the possibility of real-time monitoring of binding dynamics between antigens in solution phase and the immobilized antibodies. For multiplexed detection, the microlasers are employed in a flow cytometer configuration, with fast spectral detection and identification of microlasers with and without antigen binding. We envision that by combining microlasers with well-established surface modification chemistries and flow geometries, the multiplexing ability of microbead immunoassays can be strongly increased while also opening avenues for single cell profiling within heterogenous cell populations.


title: The Isochronal Phase of Stochastic PDE and Integral Equations: Metastability and Other Properties

abstract: We study the dynamics of waves, oscillations, and other spatio-temporal patterns in stochastic evolution systems, including SPDE and stochastic integral equations. Representing a given pattern as a smooth, stable invariant manifold of the deterministic dynamics, we reduce the stochastic dynamics to a finite dimensional SDE on this manifold using the isochronal phase. The isochronal phase is defined by mapping a neighbourbhood of the manifold onto the manifold itself, analogous to the isochronal phase defined for finite-dimensional oscillators by A.T.~Winfree and J.~Guckenheimer. We then determine a probability measure that indicates the average position of the stochastic perturbation of the pattern/wave as it wanders over the manifold. It is proved that this probability measure is accurate on time-scales greater than $O(\sigma^{-2})$, but less than $O(\exp(C\sigma^{-2}))$, where $\sigma\ll1$ is the amplitude of the stochastic perturbation. Moreover, using this measure, we determine the expected velocity of the difference between the deterministic and stochastic motion on the manifold.


title: Asymptotic Approximate Fekete Arrays

abstract: The notion of asymptotic Fekete arrays, arrays of points in a compact set $K\subset {\bf C}^d$ which behave asymptotically like Fekete arrays, has been well-studied, albeit much more recently in dimensions $d>1$. Here we show that one can allow a more flexible definition where the points in the array need not lie in $K$. Our results, which work in the general setting of weighted pluripotential theory, rely heavily, in the multidimensional setting, on the ground-breaking work of Berman, Boucksom and Nystrom.


title: Why Should Adversarial Perturbations be Imperceptible? Rethink the Research Paradigm in Adversarial NLP

abstract: Textual adversarial samples play important roles in multiple subfields of NLP research, including security, evaluation, explainability, and data augmentation. However, most work mixes all these roles, obscuring the problem definitions and research goals of the security role that aims to reveal the practical concerns of NLP models. In this paper, we rethink the research paradigm of textual adversarial samples in security scenarios. We discuss the deficiencies in previous work and propose our suggestions that the research on the Security-oriented adversarial NLP (SoadNLP) should: (1) evaluate their methods on security tasks to demonstrate the real-world concerns; (2) consider real-world attackers' goals, instead of developing impractical methods. To this end, we first collect, process, and release a security datasets collection Advbench. Then, we reformalize the task and adjust the emphasis on different goals in SoadNLP. Next, we propose a simple method based on heuristic rules that can easily fulfill the actual adversarial goals to simulate real-world attack methods. We conduct experiments on both the attack and the defense sides on Advbench. Experimental results show that our method has higher practical value, indicating that the research paradigm in SoadNLP may start from our new benchmark. All the code and data of Advbench can be obtained at \url{https://github.com/thunlp/Advbench}.


title: Language Models Understand Us, Poorly

abstract: Some claim language models understand us. Others won't hear it. To clarify, I investigate three views of human language understanding: as-mapping, as-reliability and as-representation. I argue that while behavioral reliability is necessary for understanding, internal representations are sufficient; they climb the right hill. I review state-of-the-art language and multi-modal models: they are pragmatically challenged by under-specification of form. I question the Scaling Paradigm: limits on resources may prohibit scaled-up models from approaching understanding. Last, I describe how as-representation advances a science of understanding. We need work which probes model internals, adds more of human language, and measures what models can learn.


title: Gauge Invariance at Large Charge

abstract: Quantum field theories with global symmetries simplify considerably in the large-charge limit allowing to compute correlators via a semiclassical expansion in the inverse powers of the conserved charges. A generalization of the approach to gauge symmetries has faced the problem of defining gauge-independent observables and, therefore, has not been developed so far. We employ the large-charge expansion to calculate the scaling dimension of the lowest-lying operators carrying $U(1)$ charge $Q$ in the critical Abelian Higgs model in $D=4-\epsilon$ dimensions to leading and next-to-leading orders in the charge and all orders in the $\epsilon$ expansion. Remarkably, the results match our independent diagrammatic computation of the three-loop scaling dimension of the operator $\phi^Q(x)$ in the Landau gauge. We argue that this matching is a consequence of the equivalence between the gauge-independent dressed two-point function of Dirac type with the gauge-dependent two-point function of $\phi^Q(x)$ in the Landau gauge. We, therefore, shed new light on the problem of defining gauge-independent exponents which has been controversial in the literature on critical superconductors as well as lay the foundation for large-charge methods in gauge theories.


title: Modular Linear Differential Operators and Generalized Rankin-Cohen Brackets

abstract: The aim in this paper is to give expressions for modular linear differential operators of any order. In particular, we show that they can all be described in terms of Rankin-Cohen brackets and a modified Rankin-Cohen bracket found by Kaneko and Koike. We also give more uniform descriptions of MLDOs in terms of canonically defined higher Serre derivatives and an extension of Rankin-Cohen brackets, as well as in terms of quasimodular forms and almost holomorphic modular forms. The last of these descriptions involves the holomorphic projection map. The paper also includes some general results on the theory of quasimodular forms on both cocompact and non-cocompact subgroups of $SL_2(\mathbb{R})$, as well as a slight sharpening of a theorem of Martin and Royer on Rankin-Cohen brackets of quasimodular forms


title: Unboxing Trustworthiness through Quantum Internet

abstract: The broad adoption of the Internet of Things during the last decade has widened the application horizons of distributed sensor networks, ranging from smart home appliances to automation, including remote sensing. Typically, these distributed systems are composed of several nodes attached to sensing devices linked by a heterogeneous communication network. The unreliable nature of these systems (e.g., devices might run out of energy or communications might become unavailable) drives practitioners to implement heavyweight fault tolerance mechanisms to identify those untrustworthy nodes that are misbehaving erratically and, thus, ensure that the sensed data from the IoT domain are correct. The overhead in the communication network degrades the overall system, especially in scenarios with limited available bandwidth that are exposed to severely harsh conditions. Quantum Internet might be a promising alternative to minimize traffic congestion and avoid worsening reliability due to the link saturation effect by using a quantum consensus layer. In this regard, the purpose of this paper is to explore and simulate the usage of quantum consensus architecture in one of the most challenging natural environments in the world where researchers need a responsive sensor network: the remote sensing of permafrost in Antarctica. More specifically, this paper 1) describes the use case of permafrost remote sensing in Antarctica, 2) proposes the usage of a quantum consensus management plane to reduce the traffic overhead associated with fault tolerance protocols, and 3) discusses, by means of simulation, possible improvements to increase the trustworthiness of a holistic telemetry system by exploiting the complexity reduction offered by the quantum parallelism. Collected insights from this research can be generalized to current and forthcoming IoT environments.


title: The impact of weak lensing on Type Ia supernovae luminosity distances

abstract: When Type Ia supernovae are used to infer cosmological parameters, their luminosities are compared to those from a homogeneous cosmology. In this note we propose a test to examine to what degree SN Ia have been observed on lines of sight where the average matter density is \textit{not} representative of the homogeneous background. We apply our test to the Pantheon SN Ia compilation, and find two redshift bins which indicate a moderate bias to over-density at $\sim 2\sigma$. We modify the Tripp estimator to explicitly de-lens SN Ia magnitudes, and show that this reduces scatter of Hubble diagram residuals. Using our revised Tripp estimator, the effect on cosmological parameters from Pantheon in $\Lambda$CDM is however small with a change in mean value from $\Omega_{\rm m} = 0.317 \pm 0.027$ (baseline) to $\Omega_{\rm m} = 0.312 \pm 0.025$ (de-lensed). For the Flat $w$CDM case it is $\Omega_{\rm m} = 0.332 \pm 0.049$ and $w = -1.16 \pm 0.16$ (baseline) versus $\Omega_{\rm m} = 0.316 \pm 0.048$ and $w = -1.12 \pm 0.15$ (de-lensed). We note that the effect of lensing on cosmological parameters may be larger for future high-z surveys.


title: Towards Procedural Fairness: Uncovering Biases in How a Toxic Language Classifier Uses Sentiment Information

abstract: Previous works on the fairness of toxic language classifiers compare the output of models with different identity terms as input features but do not consider the impact of other important concepts present in the context. Here, besides identity terms, we take into account high-level latent features learned by the classifier and investigate the interaction between these features and identity terms. For a multi-class toxic language classifier, we leverage a concept-based explanation framework to calculate the sensitivity of the model to the concept of sentiment, which has been used before as a salient feature for toxic language detection. Our results show that although for some classes, the classifier has learned the sentiment information as expected, this information is outweighed by the influence of identity terms as input features. This work is a step towards evaluating procedural fairness, where unfair processes lead to unfair outcomes. The produced knowledge can guide debiasing techniques to ensure that important concepts besides identity terms are well-represented in training datasets.


title: Relativistic star solutions in Mass-varying Massive Gravity with a diagonal metric

abstract: We investigate relativistic star solutions in Mass-Varying Massive Gravity (MVMG) with a diagonal metric. Contrary to the intuition that there is no fundamental difference between diagonal metric and non-diagonal metric solutions regarding relativistic stars, we find that with a diagonal metric, well-behaved relativistic star solutions may not exist except for trivial ones in which the graviton mass is a constant, whereas non-trivial relativistic star solutions had been found in MVMG with a non-diagonal metric. The reason is that with a diagonal metric, the field equations constitute a system of differential-algebraic equations of differential index-2 with two extra constraints that have a significant influence on the system, rendering the relativistic star solution with a non-trivial graviton mass configuration impossible in most cases.


title: Provably Safe Reinforcement Learning via Action Projection using Reachability Analysis and Polynomial Zonotopes

abstract: While reinforcement learning produces very promising results for many applications, its main disadvantage is the lack of safety guarantees, which prevents its use in safety-critical systems. In this work, we address this issue by a safety shield for nonlinear continuous systems that solve reach-avoid tasks. Our safety shield prevents applying potentially unsafe actions from a reinforcement learning agent by projecting the proposed action to the closest safe action. This approach is called action projection and is implemented via mixed-integer optimization. The safety constraints for action projection are obtained by applying parameterized reachability analysis using polynomial zonotopes, which enables to accurately capture the nonlinear effects of the actions on the system. In contrast to other state-of-the-art approaches for action projection, our safety shield can efficiently handle input constraints and dynamic obstacles, eases incorporation of the spatial robot dimensions into the safety constraints, guarantees robust safety despite process noise and measurement errors, and is well suited for high-dimensional systems, as we demonstrate on several challenging benchmark systems.


title: Separating Grains from the Chaff: Using Data Filtering to Improve Multilingual Translation for Low-Resourced African Languages

abstract: We participated in the WMT 2022 Large-Scale Machine Translation Evaluation for the African Languages Shared Task. This work describes our approach, which is based on filtering the given noisy data using a sentence-pair classifier that was built by fine-tuning a pre-trained language model. To train the classifier, we obtain positive samples (i.e. high-quality parallel sentences) from a gold-standard curated dataset and extract negative samples (i.e. low-quality parallel sentences) from automatically aligned parallel data by choosing sentences with low alignment scores. Our final machine translation model was then trained on filtered data, instead of the entire noisy dataset. We empirically validate our approach by evaluating on two common datasets and show that data filtering generally improves overall translation quality, in some cases even significantly.


title: Robustness of Demonstration-based Learning Under Limited Data Scenario

abstract: Demonstration-based learning has shown great potential in stimulating pretrained language models' ability under limited data scenario. Simply augmenting the input with some demonstrations can significantly improve performance on few-shot NER. However, why such demonstrations are beneficial for the learning process remains unclear since there is no explicit alignment between the demonstrations and the predictions. In this paper, we design pathological demonstrations by gradually removing intuitively useful information from the standard ones to take a deep dive of the robustness of demonstration-based sequence labeling and show that (1) demonstrations composed of random tokens still make the model a better few-shot learner; (2) the length of random demonstrations and the relevance of random tokens are the main factors affecting the performance; (3) demonstrations increase the confidence of model predictions on captured superficial patterns. We have publicly released our code at https://github.com/SALT-NLP/RobustDemo.


title: Verification of the Socio-Technical Aspects of Voting: The Case of the Polish Postal Vote 2020

abstract: Voting procedures are designed and implemented by people, for people, and with significant human involvement. Thus, one should take into account the human factors in order to comprehensively analyze properties of an election and detect threats. In particular, it is essential to assess how actions and strategies of the involved agents (voters, municipal office employees, mail clerks) can influence the outcome of other agents' actions as well as the overall outcome of the election. In this paper, we present our first attempt to capture those aspects in a formal multi-agent model of the Polish presidential election 2020. The election marked the first time when postal vote was universally available in Poland. Unfortunately, the voting scheme was prepared under time pressure and political pressure, and without the involvement of experts. This might have opened up possibilities for various kinds of ballot fraud, in-house coercion, etc. We propose a preliminary scalable model of the procedure in the form of a Multi-Agent Graph, and formalize selected integrity and security properties by formulas of agent logics. Then, we transform the models and formulas so that they can be input to the state-of-art model checker Uppaal. The first series of experiments demonstrates that verification scales rather badly due to the state-space explosion. However, we show that a recently developed technique of user-friendly model reduction by variable abstraction allows us to verify more complex scenarios.


title: Incorporating Relevance Feedback for Information-Seeking Retrieval using Few-Shot Document Re-Ranking

abstract: Pairing a lexical retriever with a neural re-ranking model has set state-of-the-art performance on large-scale information retrieval datasets. This pipeline covers scenarios like question answering or navigational queries, however, for information-seeking scenarios, users often provide information on whether a document is relevant to their query in form of clicks or explicit feedback. Therefore, in this work, we explore how relevance feedback can be directly integrated into neural re-ranking models by adopting few-shot and parameter-efficient learning techniques. Specifically, we introduce a kNN approach that re-ranks documents based on their similarity with the query and the documents the user considers relevant. Further, we explore Cross-Encoder models that we pre-train using meta-learning and subsequently fine-tune for each query, training only on the feedback documents. To evaluate our different integration strategies, we transform four existing information retrieval datasets into the relevance feedback scenario. Extensive experiments demonstrate that integrating relevance feedback directly in neural re-ranking models improves their performance, and fusing lexical ranking with our best performing neural re-ranker outperforms all other methods by 5.2 nDCG@20.