title: Physics as the science of the possible: Discovery in the age of Godel (1.1 Generality of physics)

abstract: This book represents a continuation, an elaboration, and possibly a clear explanation of the ideas which were expounded in the previous book Time and Methods in Environmental Interfaces Modeling (henceforth abbreviated as TM, Mihailovic et al 2016). In that book as well as in whole of our published scientific work we were either implicitly or explicitly driven by a need to understand how the space between the human mind and observed physical reality is bridged. Here we use synonymously the terms physical reality and reality since the reality is all of physical existence, and concepts related to it as opposed to those products of our mind which remain on the level of mind. Relying on that book we add our new experiences in research in which physics plays a dominant role. To these experiences we attached some epistemological features as well as a view of physics through the optics of Godel Incompleteness Theorems (Godel 1931). In the Prolegomena (Chapter 1) we consider some aspects of generality of physics (1.1 Generality of physics)


title: Multiple Laguerre polynomials: Combinatorial model and Stieltjes moment representation

abstract: I give a combinatorial interpretation of the multiple Laguerre polynomials of the first kind of type II, generalizing the digraph model found by Foata and Strehl for the ordinary Laguerre polynomials. I also give an explicit integral representation for these polynomials, which shows that they form a multidimensional Stieltjes moment sequence whenever $x \le 0$.


title: Noise Attention based Spectrum Anomaly Detection Method for Unauthorized Bands

abstract: Spectrum anomaly detection is of great importance in wireless communication to secure safety and improve spectrum efficiency. However, spectrum anomaly detection faces many difficulties, especially in unauthorized frequency bands. For example, the composition of unauthorized frequency bands is very complex and the abnormal usage patterns are unknown in prior. In this paper, a noise attention method is proposed for unsupervised spectrum anomaly detection in unauthorized bands. First of all, we theoretically prove that the anomalies in unauthorized bands will raise the noise floor of spectrogram after VAE reconstruction. Then, we introduce a novel anomaly metric named as noise attention score to more effectively capture spectrum anomaly. The effectiveness of the proposed method is experimentally verified in 2.4 GHz ISM band. Leveraging the noise attention score, the AUC metric of anomaly detection is increased by 0.193. The proposed method is beneficial to reliably detecting abnormal spectrum while keeping low false alarm rate.


title: A Novel Class of Starlike Functions

abstract: In the past several subclasses of starlike functions are defined involving real part and modulus of certain expressions of functions under study, combined by way of an inequality. In the similar fashion, we introduce a new class $\mathcal{S}^*_{q}(\alpha)$, consisting of normalized analytic univalent functions $f$ in the open unit disk $\mathbb{D}$, satisfying $$\RE\left(\dfrac{z f'(z)}{f(z)}\right) \geq \left|1+\dfrac{z f''(z)}{f'(z)} -\dfrac{z f'(z)}{f(z)}-\alpha\right| \quad (0 \leq \alpha <1).$$ Evidently, $\mathcal{S}^*_{q}(\alpha) \subset \mathcal{S}^*$, the class of starlike functions. We first establish $\mathcal{S}^*_{q}(\alpha) \subset \mathcal{S}^*(q_\alpha)$, the class of analytic functions $f$ satisfying $z f'(z)/f(z)\prec q_\alpha(z),$ where $q_\alpha$ is an extremal function. Some necessary and sufficient conditions for functions belonging to these classes are obtained in addition to the inclusion and radius problems. Further, we estimate logarithmic coefficients, inverse coefficients and Fekete-Szeg\"o functional bounds for functions in $ \mathcal{S}^*(q_\alpha)$.


title: Efficient Screening of Diseased Eyes based on Fundus Autofluorescence Images using Support Vector Machine

abstract: A variety of vision ailments are associated with geographic atrophy (GA) in the foveal region of the eye. In current clinical practice, the ophthalmologist manually detects potential presence of such GA based on fundus autofluorescence (FAF) images, and hence diagnoses the disease, when relevant. However, in view of the general scarcity of ophthalmologists relative to the large number of subjects seeking eyecare, especially in remote regions, it becomes imperative to develop methods to direct expert time and effort to medically significant cases. Further, subjects from either disadvantaged background or remote localities, who face considerable economic/physical barrier in consulting trained ophthalmologists, tend to seek medical attention only after being reasonably certain that an adverse condition exists. To serve the interest of both the ophthalmologist and the potential patient, we plan a screening step, where healthy and diseased eyes are algorithmically differentiated with limited input from only optometrists who are relatively more abundant in number. Specifically, an early treatment diabetic retinopathy study (ETDRS) grid is placed by an optometrist on each FAF image, based on which sectoral statistics are automatically collected. Using such statistics as features, healthy and diseased eyes are proposed to be classified by training an algorithm using available medical records. In this connection, we demonstrate the efficacy of support vector machines (SVM). Specifically, we consider SVM with linear as well as radial basis function (RBF) kernel, and observe satisfactory performance of both variants. Among those, we recommend the latter in view of its slight superiority in terms of classification accuracy (90.55% at a standard training-to-test ratio of 80:20), and practical class-conditional costs.


title: Fermion scattering on topological solitons in the nonlinear $O(3)$ $\sigma$-model

abstract: The scattering of Dirac fermions in the background fields of topological solitons of the $(2+1)$-dimensional nonlinear $O(3)$ $\sigma$-model is studied using both analytical and numerical methods. General formulae describing fermion scattering are obtained and the symmetry properties of the partial scattering amplitudes and elements of the $S$-matrix are determined. Within the framework of the Born approximation, the scattering amplitudes, differential cross-sections, and total cross-sections of fermion-soliton scattering are obtained in analytical forms, and their symmetry properties and asymptotic behavior are investigated. The dependences of the first several partial elements of the $S$-matrix on the momentum of the fermion are obtained using numerical methods, and some properties of these dependences are ascertained and discussed.


title: Embodying Pre-Trained Word Embeddings Through Robot Actions

abstract: We propose a promising neural network model with which to acquire a grounded representation of robot actions and the linguistic descriptions thereof. Properly responding to various linguistic expressions, including polysemous words, is an important ability for robots that interact with people via linguistic dialogue. Previous studies have shown that robots can use words that are not included in the action-description paired datasets by using pre-trained word embeddings. However, the word embeddings trained under the distributional hypothesis are not grounded, as they are derived purely from a text corpus. In this letter, we transform the pre-trained word embeddings to embodied ones by using the robot's sensory-motor experiences. We extend a bidirectional translation model for actions and descriptions by incorporating non-linear layers that retrofit the word embeddings. By training the retrofit layer and the bidirectional translation model alternately, our proposed model is able to transform the pre-trained word embeddings to adapt to a paired action-description dataset. Our results demonstrate that the embeddings of synonyms form a semantic cluster by reflecting the experiences (actions and environments) of a robot. These embeddings allow the robot to properly generate actions from unseen words that are not paired with actions in a dataset.


title: Quantifying the Need for Attorney Pro Bono Services in Connection with the Social Determinants of Health

abstract: The paper estimates the need for additional attorney hours annually to address the legal needs of indigent clients throughout the United States in matters that comprise the so-called social determinants of health (SDoH). The result will inform stakeholders such as policy makers and private donors so they can allocate resources appropriately and design programs to close the do-called justice gap. As a pilot study, the scope of the project covers only a few major justice problems related to the social determinants of health (standard housing, evictions and foreclosures, guardianships for the incapacitated, and victims of domestic violence) because they significantly impact health outcomes and there are data available. Based on our calculations, we estimate that the total number of attorney hours to address only these five legal issues is over 34 million per year. To put that in perspective, the American Bar Association estimated that in 2018, the year from which much of our data comes, the total number of practicing attorneys in the United States was 1,338,678 (Weiss). Thus, to provide the needed hours, every single practicing attorney in the United States would need to contribute about 26 hours a year. While many lawyers do in fact contribute pro bono hours, they address the full range of legal needs that go well beyond just the five we studied.


title: Co-BERT: A Context-Aware BERT Retrieval Model Incorporating Local and Query-specific Context

abstract: BERT-based text ranking models have dramatically advanced the state-of-the-art in ad-hoc retrieval, wherein most models tend to consider individual query-document pairs independently. In the mean time, the importance and usefulness to consider the cross-documents interactions and the query-specific characteristics in a ranking model have been repeatedly confirmed, mostly in the context of learning to rank. The BERT-based ranking model, however, has not been able to fully incorporate these two types of ranking context, thereby ignoring the inter-document relationships from the ranking and the differences among queries. To mitigate this gap, in this work, an end-to-end transformer-based ranking model, named Co-BERT, has been proposed to exploit several BERT architectures to calibrate the query-document representations using pseudo relevance feedback before modeling the relevance of a group of documents jointly. Extensive experiments on two standard test collections confirm the effectiveness of the proposed model in improving the performance of text re-ranking over strong fine-tuned BERT-Base baselines. We plan to make our implementation open source to enable further comparisons.


title: Multilingual and Cross-Lingual Intent Detection from Spoken Data

abstract: We present a systematic study on multilingual and cross-lingual intent detection from spoken data. The study leverages a new resource put forth in this work, termed MInDS-14, a first training and evaluation resource for the intent detection task with spoken data. It covers 14 intents extracted from a commercial system in the e-banking domain, associated with spoken examples in 14 diverse language varieties. Our key results indicate that combining machine translation models with state-of-the-art multilingual sentence encoders (e.g., LaBSE) can yield strong intent detectors in the majority of target languages covered in MInDS-14, and offer comparative analyses across different axes: e.g., zero-shot versus few-shot learning, translation direction, and impact of speech recognition. We see this work as an important step towards more inclusive development and evaluation of multilingual intent detectors from spoken data, in a much wider spectrum of languages compared to prior work.


title: On comparison of the second-order statistics from independent and interdependent exponentiated location-scale distributed random variables

abstract: Consider two batches of independent or interdependent exponentiated location-scale distributed heterogeneous random variables. This article investigates ordering results for the second-order statistics from these batches when a vector of parameters is switched to another vector of parameters in the specified model. Sufficient conditions for the usual stochastic order and the hazard rate order are derived. Some applications of the established results are presented.


title: Noncommutative differential transforms for averaging operators

abstract: In this paper, we complete the study of mapping properties for a family of operators evaluating the difference between differentiation operators and conditional expectations acting on noncommutative $L_{p}$-spaces. To be more precise, we establish the weak type $(1,1)$ and $(L_{\infty},\mathrm{BMO})$ estimates of this difference. Consequently, in conjunction with interpolation and duality, we obtain all strong type $(p,p)$ estimates. This allows us to obtain a quick application to noncommutative differential transforms for averaging operators.


title: PARE: Part Attention Regressor for 3D Human Body Estimation

abstract: Despite significant progress, we show that state of the art 3D human pose and shape estimation methods remain sensitive to partial occlusion and can produce dramatically wrong predictions although much of the body is observable. To address this, we introduce a soft attention mechanism, called the Part Attention REgressor (PARE), that learns to predict body-part-guided attention masks. We observe that state-of-the-art methods rely on global feature representations, making them sensitive to even small occlusions. In contrast, PARE's part-guided attention mechanism overcomes these issues by exploiting information about the visibility of individual body parts while leveraging information from neighboring body-parts to predict occluded parts. We show qualitatively that PARE learns sensible attention masks, and quantitative evaluation confirms that PARE achieves more accurate and robust reconstruction results than existing approaches on both occlusion-specific and standard benchmarks. The code and data are available for research purposes at {\small \url{https://pare.is.tue.mpg.de/}}


title: ECLIPSE: a fast Quadratic Maximum Likelihood estimator for CMB intensity and polarization power spectra

abstract: We present ECLIPSE (Efficient Cmb poLarization and Intensity Power Spectra Estimator), an optimized implementation of the Quadratic Maximum Likelihood (QML) method for the estimation of the power spectra of the Cosmic Microwave Background (CMB). This approach allows one to reduce significantly the computational costs associated to this technique, allowing to estimate the power spectra up to higher multipoles than previous implementations. In particular, for a resolution of $N_\mathrm{side}=64$, $\ell_{\mathrm{max}}=192$ and a typical Galactic mask, the number of operations can be reduced by approximately a factor of 1000 in a full analysis including intensity and polarization with respect to an efficient direct implementation of the method. In addition, if one is interested in studying only polarization, it is possible to obtain the power spectra of the E and B modes with a further reduction of computational resources without degrading the results. We also show that for experiments observing a small fraction of the sky, the Fisher matrix becomes singular and, in this case, the standard QML can not be applied. To solve this problem, we have developed a binned version of the method that is unbiased and of minimum variance. We also test the robustness of the QML estimator when the assumed fiducial model differs from that of the sky and show the performance of an iterative approach. Finally, we present a comparison of the results obtained by QML and a pseudo-$C_{\ell}$ estimator (NaMaster) for a next-generation satellite, showing that, as expected, QML produces significantly smaller errors at low multipoles. The ECLIPSE fast QML code developed in this work will be made publicly available.


title: The Impact of ASR on the Automatic Analysis of Linguistic Complexity and Sophistication in Spontaneous L2 Speech

abstract: In recent years, automated approaches to assessing linguistic complexity in second language (L2) writing have made significant progress in gauging learner performance, predicting human ratings of the quality of learner productions, and benchmarking L2 development. In contrast, there is comparatively little work in the area of speaking, particularly with respect to fully automated approaches to assessing L2 spontaneous speech. While the importance of a well-performing ASR system is widely recognized, little research has been conducted to investigate the impact of its performance on subsequent automatic text analysis. In this paper, we focus on this issue and examine the impact of using a state-of-the-art ASR system for subsequent automatic analysis of linguistic complexity in spontaneously produced L2 speech. A set of 30 selected measures were considered, falling into four categories: syntactic, lexical, n-gram frequency, and information-theoretic measures. The agreement between the scores for these measures obtained on the basis of ASR-generated vs. manual transcriptions was determined through correlation analysis. A more differential effect of ASR performance on specific types of complexity measures when controlling for task type effects is also presented.


title: The Topic Confusion Task: A Novel Scenario for Authorship Attribution

abstract: Authorship attribution is the problem of identifying the most plausible author of an anonymous text from a set of candidate authors. Researchers have investigated same-topic and cross-topic scenarios of authorship attribution, which differ according to whether new, unseen topics are used in the testing phase. However, neither scenario allows us to explain whether errors are caused by a failure to capture authorship writing style or by a topic shift. Motivated by this, we propose the \emph{topic confusion} task where we switch the author-topic configuration between the training and testing sets. This setup allows us to distinguish two types of errors: those caused by the topic shift and those caused by the features' inability to capture the writing styles. We show that stylometric features with part-of-speech tags are the least susceptible to topic variations. We further show that combining them with other features leads to significantly lower topic confusion and higher attribution accuracy. Finally, we show that pretrained language models such as BERT and RoBERTa perform poorly on this task and are surpassed by simple features such as word-level $n$-grams.


title: Hadron resonance gas model with repulsive mean-field interactions: specific heat, isothermal compressibility and speed of sound

abstract: We investigate the effect of repulsive interaction between hadrons on the specific heat ($C_V$), isothermal compressibility ($\kappa_{T}$) and the speed of sound ($C_s^2$) of hot and dense hadronic matter. The repulsive interactions are included through a mean-field approach where the single particle energy picks correction term due to mean field interactions between hadrons. This correction term is proportional to the number density of hadrons. We assume different mean-field interactions for mesons and baryons. We also confront $C_V$ and $C_s^2$ with existing lattice QCD simulation results. We find that the repulsive interactions have very strong effect on $C_V$ and $C_s^2$ while its effect on $\kappa_T$ is very mild. We finally discuss the implications of our results in the context of heavy-ion collision experiments.


title: First Order Hyperbolic Boundary Value Problems With a Large Oscillatory Zero Order Term

abstract: We study the weakly stable hyperbolic boundary value problem with a large zero order oscillatory coefficient. This problem is related to linearized problems in the study of Mach stem and vortex sheets. We wish to establish a uniform energy estimate with respect to {\epsilon}, which is needed in mentioned applications and justification of geometric optics solutions, but the zero order oscillatory term gives rise to great obstacles. In this paper we obtain positive results in the small/medium frequency region by adapting the approach of Williams to a more general situation than the one treated there. We also show that it is possible to construct high order approximate solutions by the method of geometric optics for those systems without any restriction on frequencies.


title: On Oblique Domains of Janowski Function

abstract: We investigate certain properties of tilted (oblique) domains, associated with the Janowski function $(1+Az)/(1+Bz),$ where $A,B\in\mathbb{C}$ with $A\neq B$ and $|B|\leq 1$. We find several bounds for these oblique domains. Further, we extend the various known argument, radius, and subordination results involving Janowski functions with complex parameters.


title: Centrally symmetric analytic plane domains are spectrally determined in this class

abstract: We prove that, under some generic non-degeneracy assumptions, real analytic, centrally symmetric plane domains are determined by their Dirichlet (resp. Neumann) spectra. We prove that the conditions are open-dense for real analytic convex domains. The proof is parallel to the proof that up/down symmetric domains are spectrally determined. One step is to use a Maslov index calculation to show that the second derivative of the defining function of a centrally symmetric domain at the endpoints of a bouncing ball orbit is a spectral invariant. This is also true for up/down symmetric domains, removing an assumption from the proof in that case.


title: The challenges of temporal alignment on Twitter during crises

abstract: Language use changes over time, and this impacts the effectiveness of NLP systems. This phenomenon is even more prevalent in social media data during crisis events where meaning and frequency of word usage may change over the course of days. Contextual language models fail to adapt temporally, emphasizing the need for temporal adaptation in models which need to be deployed over an extended period of time. While existing approaches consider data spanning large periods of time (from years to decades), shorter time spans are critical for crisis data. We quantify temporal degradation for this scenario and propose methods to cope with performance loss by leveraging techniques from domain adaptation. To the best of our knowledge, this is the first effort to explore effects of rapid language change driven by adversarial adaptations, particularly during natural and human-induced disasters. Through extensive experimentation on diverse crisis datasets, we analyze under what conditions our approaches outperform strong baselines while highlighting the current limitations of temporal adaptation methods in scenarios where access to unlabeled data is scarce.


title: Multi-Perspective Abstractive Answer Summarization

abstract: Community Question Answering (CQA) forums such as Stack Overflow and Yahoo! Answers contain a rich resource of answers to a wide range of questions. Each question thread can receive a large number of answers with different perspectives. The goal of multi-perspective answer summarization is to produce a summary that includes all perspectives of the answer. A major obstacle for multi-perspective, abstractive answer summarization is the absence of a dataset to provide supervision for producing such summaries. This work introduces a novel dataset creation method to automatically create multi-perspective, bullet-point abstractive summaries from an existing CQA forum. Supervision provided by this dataset trains models to inherently produce multi-perspective summaries. Additionally, to train models to output more diverse, faithful answer summaries while retaining multiple perspectives, we propose a multi-reward optimization technique coupled with a sentence-relevance prediction multi-task loss. Our methods demonstrate improved coverage of perspectives and faithfulness as measured by automatic and human evaluations compared to a strong baseline.


title: Emergence of Lie symmetries in functional architectures learned by CNNs

abstract: In this paper we study the spontaneous development of symmetries in the early layers of a Convolutional Neural Network (CNN) during learning on natural images. Our architecture is built in such a way to mimic the early stages of biological visual systems. In particular, it contains a pre-filtering step $\ell^0$ defined in analogy with the Lateral Geniculate Nucleus (LGN). Moreover, the first convolutional layer is equipped with lateral connections defined as a propagation driven by a learned connectivity kernel, in analogy with the horizontal connectivity of the primary visual cortex (V1). The layer $\ell^0$ shows a rotational symmetric pattern well approximated by a Laplacian of Gaussian (LoG), which is a well-known model of the receptive profiles of LGN cells. The convolutional filters in the first layer can be approximated by Gabor functions, in agreement with well-established models for the profiles of simple cells in V1. We study the learned lateral connectivity kernel of this layer, showing the emergence of orientation selectivity w.r.t. the learned filters. We also examine the association fields induced by the learned kernel, and show qualitative and quantitative comparisons with known group-based models of V1 horizontal connectivity. These geometric properties arise spontaneously during the training of the CNN architecture, analogously to the emergence of symmetries in visual systems thanks to brain plasticity driven by external stimuli.


title: Cycle-free CycleGAN using Invertible Generator for Unsupervised Low-Dose CT Denoising

abstract: Recently, CycleGAN was shown to provide high-performance, ultra-fast denoising for low-dose X-ray computed tomography (CT) without the need for a paired training dataset. Although this was possible thanks to cycle consistency, CycleGAN requires two generators and two discriminators to enforce cycle consistency, demanding significant GPU resources and technical skills for training. A recent proposal of tunable CycleGAN with Adaptive Instance Normalization (AdaIN) alleviates the problem in part by using a single generator. However, two discriminators and an additional AdaIN code generator are still required for training. To solve this problem, here we present a novel cycle-free Cycle-GAN architecture, which consists of a single generator and a discriminator but still guarantees cycle consistency. The main innovation comes from the observation that the use of an invertible generator automatically fulfills the cycle consistency condition and eliminates the additional discriminator in the CycleGAN formulation. To make the invertible generator more effective, our network is implemented in the wavelet residual domain. Extensive experiments using various levels of low-dose CT images confirm that our method can significantly improve denoising performance using only 10% of learnable parameters and faster training time compared to the conventional CycleGAN.


title: Multi-octave high-dynamic range optical spectrometer for single-pulse diagnostic applications

abstract: We present design and realization of an ultra-broadband optical spectrometer capable of measuring the spectral intensity of multi-octave-spanning light sources on a single-pulse basis with a dynamic range of up to 8 orders of magnitude. The instrument is optimized for the characterization of the temporal structure of femtosecond long electron bunches by analyzing the emitted coherent transition radiation (CTR) spectra. The spectrometer operates within the spectral range of 250nm to 11.35$\mu$m, corresponding to 5.5 optical octaves. This is achieved by dividing the signal beam into three spectral groups, each analyzed by a dedicated spectrometer and detector unit. The complete instrument was characterized with regard to wavelength, relative spectral sensitivity, and absolute photo-metric sensitivity, always accounting for the light polarization and comparing different calibration methods. Finally, the capability of the spectrometer is demonstrated with a CTR measurement of a laser wakefield accelerated electron bunch, enabling to determine temporal pulse structures at unprecedented resolution.


title: DWUG: A large Resource of Diachronic Word Usage Graphs in Four Languages

abstract: Word meaning is notoriously difficult to capture, both synchronically and diachronically. In this paper, we describe the creation of the largest resource of graded contextualized, diachronic word meaning annotation in four different languages, based on 100,000 human semantic proximity judgments. We thoroughly describe the multi-round incremental annotation process, the choice for a clustering algorithm to group usages into senses, and possible - diachronic and synchronic - uses for this dataset.


title: TransVG: End-to-End Visual Grounding with Transformers

abstract: In this paper, we present a neat yet effective transformer-based framework for visual grounding, namely TransVG, to address the task of grounding a language query to the corresponding region onto an image. The state-of-the-art methods, including two-stage or one-stage ones, rely on a complex module with manually-designed mechanisms to perform the query reasoning and multi-modal fusion. However, the involvement of certain mechanisms in fusion module design, such as query decomposition and image scene graph, makes the models easily overfit to datasets with specific scenarios, and limits the plenitudinous interaction between the visual-linguistic context. To avoid this caveat, we propose to establish the multi-modal correspondence by leveraging transformers, and empirically show that the complex fusion modules e.g., modular attention network, dynamic graph, and multi-modal tree) can be replaced by a simple stack of transformer encoder layers with higher performance. Moreover, we re-formulate the visual grounding as a direct coordinates regression problem and avoid making predictions out of a set of candidates i.e., region proposals or anchor boxes). Extensive experiments are conducted on five widely used datasets, and a series of state-of-the-art records are set by our TransVG. We build the benchmark of transformer-based visual grounding framework and make the code available at \url{https://github.com/djiajunustc/TransVG}.


title: ScaleFreeCTR: MixCache-based Distributed Training System for CTR Models with Huge Embedding Table

abstract: Because of the superior feature representation ability of deep learning, various deep Click-Through Rate (CTR) models are deployed in the commercial systems by industrial companies. To achieve better performance, it is necessary to train the deep CTR models on huge volume of training data efficiently, which makes speeding up the training process an essential problem. Different from the models with dense training data, the training data for CTR models is usually high-dimensional and sparse. To transform the high-dimensional sparse input into low-dimensional dense real-value vectors, almost all deep CTR models adopt the embedding layer, which easily reaches hundreds of GB or even TB. Since a single GPU cannot afford to accommodate all the embedding parameters, when performing distributed training, it is not reasonable to conduct the data-parallelism only. Therefore, existing distributed training platforms for recommendation adopt model-parallelism. Specifically, they use CPU (Host) memory of servers to maintain and update the embedding parameters and utilize GPU worker to conduct forward and backward computations. Unfortunately, these platforms suffer from two bottlenecks: (1) the latency of pull \& push operations between Host and GPU; (2) parameters update and synchronization in the CPU servers. To address such bottlenecks, in this paper, we propose the ScaleFreeCTR: a MixCache-based distributed training system for CTR models. Specifically, in SFCTR, we also store huge embedding table in CPU but utilize GPU instead of CPU to conduct embedding synchronization efficiently. To reduce the latency of data transfer between both GPU-Host and GPU-GPU, the MixCache mechanism and Virtual Sparse Id operation are proposed. Comprehensive experiments and ablation studies are conducted to demonstrate the effectiveness and efficiency of SFCTR.


title: Planning with Expectation Models for Control

abstract: In model-based reinforcement learning (MBRL), Wan et al. (2019) showed conditions under which the environment model could produce the expectation of the next feature vector rather than the full distribution, or a sample thereof, with no loss in planning performance. Such expectation models are of interest when the environment is stochastic and non-stationary, and the model is approximate, such as when it is learned using function approximation. In these cases a full distribution model may be impractical and a sample model may be either more expensive computationally or of high variance. Wan et al. considered only planning for prediction to evaluate a fixed policy. In this paper, we treat the control case - planning to improve and find a good approximate policy. We prove that planning with an expectation model must update a state-value function, not an action-value function as previously suggested (e.g., Sorg & Singh, 2010). This opens the question of how planning influences action selections. We consider three strategies for this and present general MBRL algorithms for each. We identify the strengths and weaknesses of these algorithms in computational experiments. Our algorithms and experiments are the first to treat MBRL with expectation models in a general setting.


title: Parsec-scale properties of the peculiar gigahertz-peaked spectrum quasar 0858-279

abstract: We performed multi-frequency studies on the gigahertz-peaked spectrum high-redshift quasar 0858-279. Initially, the source presented itself in the early VLBI images as a very peculiar resolved blob. We observed the quasar with the VLBA at 1.4-24 GHz in a dual-polarization mode. The high spatial resolution and the spectral index maps enabled us to resolve the core-jet structure and locate a weak and compact core by its inverted spectrum. The dominant jet component 20 parsecs away from the core was optically thin above 10 GHz and opaque below it. We also estimated an uncommonly strong magnetic field in the bright jet feature, which turned out to be around 1 G. The Faraday rotation measure maps revealed high RM values over 6000 rad/m^2. Additionally, these maps allowed us to follow the magnetic field direction in the bright jet feature being perpendicular to the propagation direction of the jet. All the results strongly indicated the formation of a shock wave in the dominant component arising from an interaction with the surrounding matter. Using the proposed hypothesis and the core shift approach, we discovered that the magnetic field in the core region is of the order of 0.1 G.


title: Localized and extended dynamical correlation lengths in jammed packings of soft athermal disks under slow shear

abstract: Dynamics of jammed packings of soft athermal disks under finite-rate shear are studied by means of molecular dynamics simulations. Particularly, we investigate the spatial structures of stress drop events, which are expected to provide information about plasticity. Investigating the displacement fields during stress drop events, we show that there are qualitatively different two types of events in the low rate limit: localized ones and extended ones. We further investigate the time evolution of events and clarify that both types of events are due to oscillatory motion of the stress, which is unique for systems under finite-rate shear. The difference between two types of events is the regime that events reside in: while localized events take place during plastic events, extended ones occur in the elastic branch.


title: Fuzzy Discriminant Clustering with Fuzzy Pairwise Constraints

abstract: In semi-supervised fuzzy clustering, this paper extends the traditional pairwise constraint (i.e., must-link or cannot-link) to fuzzy pairwise constraint. The fuzzy pairwise constraint allows a supervisor to provide the grade of similarity or dissimilarity between the implicit fuzzy vectors of a pair of samples. This constraint can present more complicated relationship between the pair of samples and avoid eliminating the fuzzy characteristics. We propose a fuzzy discriminant clustering model (FDC) to fuse the fuzzy pairwise constraints. The nonconvex optimization problem in our FDC is solved by a modified expectation-maximization algorithm, involving to solve several indefinite quadratic programming problems (IQPPs). Further, a diagonal block coordinate decent (DBCD) algorithm is proposed for these IQPPs, whose stationary points are guaranteed, and the global solutions can be obtained under certain conditions. To suit for different applications, the FDC is extended into various metric spaces, e.g., the Reproducing Kernel Hilbert Space. Experimental results on several benchmark datasets and facial expression database demonstrate the outperformance of our FDC compared with some state-of-the-art clustering models.


title: Characterization of the Firm-Firm Public Procurement Co-Bidding Network from the State of Cear\'a (Brazil) Municipalities

abstract: Fraud in public funding can have deleterious consequences for the economic, social, and political well-being of societies. Fraudulent activity associated with public procurement contracts accounts for losses of billions of euros every year. Thus, it is of utmost relevance to explore analytical frameworks that can help public authorities identify agents that are more susceptible to incur in irregular activities. Here, we use standard network science methods to study the co-biding relationships between firms that participate in public tenders issued by the $184$ municipalities of the State of Cear\'a (Brazil) between 2015 and 2019. We identify $22$ groups/communities of firms with similar patterns of procurement activity, defined by their geographic and activity scopes. The profiling of the communities allows us to highlight groups that are more susceptible to market manipulation and irregular activities. Our work reinforces the potential application of network analysis in policy to unfold the complex nature of relationships between market agents in a scenario of scarce data.


title: Potential Anchoring for imbalanced data classification

abstract: Data imbalance remains one of the factors negatively affecting the performance of contemporary machine learning algorithms. One of the most common approaches to reducing the negative impact of data imbalance is preprocessing the original dataset with data-level strategies. In this paper we propose a unified framework for imbalanced data over- and undersampling. The proposed approach utilizes radial basis functions to preserve the original shape of the underlying class distributions during the resampling process. This is done by optimizing the positions of generated synthetic observations with respect to the potential resemblance loss. The final Potential Anchoring algorithm combines over- and undersampling within the proposed framework. The results of the experiments conducted on 60 imbalanced datasets show outperformance of Potential Anchoring over state-of-the-art resampling algorithms, including previously proposed methods that utilize radial basis functions to model class potential. Furthermore, the results of the analysis based on the proposed data complexity index show that Potential Anchoring is particularly well suited for handling naturally complex (i.e. not affected by the presence of noise) datasets.


title: Link-Level Performance Evaluation of IMT-2020 Candidate Technology: DECT-2020 New Radio

abstract: The ETSI has recently introduced the DECT-2020 New Radio (NR) as an IMT-2020 candidate technology for the mMTC and URLLC use cases. To consider DECT-2020 NR as an IMT-2020 technology, the ITU-R has determined different independent evaluation groups to assess its performance against the IMT-2020 requirements. These independent evaluation groups are now in process of investigating the DECT-2020 NR. In order to successfully assess a technology, one important aspect is to fully understand the underlying physical layer and its performance in different environments. Therefore, in this paper, we focus on the physical layer of DECT-2020 NR and investigate its link-level performance with standard channel models provided by the ITU-R for evaluation. We perform extensive simulations to analyze the performance of DECT-2020 NR for both URLLC and mMTC use cases. The results presented in this work are beneficial for the independent evaluation groups and researchers as these results can help calibrating their physical layer performance curves. These results can also be used directly for future system-level evaluations of DECT-2020 NR.


title: Asymmetric Conductivity of the Kondo Effect in Cold Atomic Systems

abstract: Motivated by recent theoretical and experimental advances in quantum simulations using alkaline earth(AE) atoms, we put forward a proposal to detect the Kondo physics in a cold atomic system. It has been demonstrated that the intrinsic spin-exchange interaction in AE atoms can be significantly enhanced near a confinement-induced resonance(CIR), which facilitates the simulation of Kondo physics. Since the Kondo effect appears only for antiferromagnetic coupling, we find that the conductivity of such a system exhibits an asymmetry across a resonance of spin-exchange interaction. The asymmetric conductivity can serve as the smoking gun evidence for Kondo physics in the cold atom context. When an extra magnetic field ramps up, the spin-exchange process near the Fermi surface is suppressed by Zeeman energy and the conductivity becomes more and more symmetric. Our results can be verified in the current experimental setup.


title: Multi-source Neural Topic Modeling in Multi-view Embedding Spaces

abstract: Though word embeddings and topics are complementary representations, several past works have only used pretrained word embeddings in (neural) topic modeling to address data sparsity in short-text or small collection of documents. This work presents a novel neural topic modeling framework using multi-view embedding spaces: (1) pretrained topic-embeddings, and (2) pretrained word-embeddings (context insensitive from Glove and context-sensitive from BERT models) jointly from one or many sources to improve topic quality and better deal with polysemy. In doing so, we first build respective pools of pretrained topic (i.e., TopicPool) and word embeddings (i.e., WordPool). We then identify one or more relevant source domain(s) and transfer knowledge to guide meaningful learning in the sparse target domain. Within neural topic modeling, we quantify the quality of topics and document representations via generalization (perplexity), interpretability (topic coherence) and information retrieval (IR) using short-text, long-text, small and large document collections from news and medical domains. Introducing the multi-source multi-view embedding spaces, we have shown state-of-the-art neural topic modeling using 6 source (high-resource) and 5 target (low-resource) corpora.


title: Replicating analyses of item response curves using data from the Force and Motion Conceptual Evaluation

abstract: Ishimoto, Davenport, and Wittmann have previously reported analyses of data from student responses to the Force and Motion Conceptual Evaluation (FMCE), in which they used item response curves (IRCs) to make claims about American and Japanese students' relative likelihood to choose certain incorrect responses to some questions. We have used an independent data set of over 6,500 American students' responses to the FMCE to generate IRCs to test their claims. Converting the IRCs to vectors, we used dot product analysis to compare each response item quantitatively. For most questions, our analyses are consistent with Ishimoto, Davenport, and Wittmann, with some results suggesting more minor differences between American and Japanese students than previously reported. We also highlight the pedagogical advantages of using IRCs to determine the differences in response patterns for different populations to better understand student thinking prior to instruction.


title: Exploring Cybersecurity Issues in 5G Enabled Electric Vehicle Charging Station with Deep Learning

abstract: The surging usage of electric vehicles (EVs) demand the robust deployment of trustworthy electric vehicle charging station (EVCS) with millisecond range latency and massive machine to machine communications where 5G could act. However, 5G suffers from inherent protocols, hardware, and software vulnerabilities that seriously threaten the communicating entities' cyber-physical security. To overcome these limitations in the EVCS system, this paper analyses the impact of False Data Injection (FDI) and Distributed Denial of Services (DDoS) attacks on the operation of EVCS. This work is an extension of our previously published conference paper about the EVCS. As new features, this paper simulates the FDI attack and the syn flood DDoS attacks on 5G enabled remote Supervisory Control and Data Acquisition (SCADA) system that controls the solar photovoltaics (PV) controller, Battery Energy Storage (BES) controller, and EV controller of the EVCS. The attacks make the EVCS system oscillate or shift the DC operating point. The frequency of oscillation, its damping, and the system's resiliency are found to be related to the attacks' intensity and target controller. Finally, we propose the novel stacked Long Short-Term Memory (LSTM) based intrusion detection systems (IDS) solely based on the electrical fingerprint. This model can detect the stealthy cyberattacks that bypass the cyber layer and go unnoticed in the monitoring system with nearly 100% detection accuracy.


title: Objective-Dependent Uncertainty Driven Retinal Vessel Segmentation

abstract: From diagnosing neovascular diseases to detecting white matter lesions, accurate tiny vessel segmentation in fundus images is critical. Promising results for accurate vessel segmentation have been known. However, their effectiveness in segmenting tiny vessels is still limited. In this paper, we study retinal vessel segmentation by incorporating tiny vessel segmentation into our framework for the overall accurate vessel segmentation. To achieve this, we propose a new deep convolutional neural network (CNN) which divides vessel segmentation into two separate objectives. Specifically, we consider the overall accurate vessel segmentation and tiny vessel segmentation as two individual objectives. Then, by exploiting the objective-dependent (homoscedastic) uncertainty, we enable the network to learn both objectives simultaneously. Further, to improve the individual objectives, we propose: (a) a vessel weight map based auxiliary loss for enhancing tiny vessel connectivity (i.e., improving tiny vessel segmentation), and (b) an enhanced encoder-decoder architecture for improved localization (i.e., for accurate vessel segmentation). Using 3 public retinal vessel segmentation datasets (CHASE_DB1, DRIVE, and STARE), we verify the superiority of our proposed framework in segmenting tiny vessels (8.3% average improvement in sensitivity) while achieving better area under the receiver operating characteristic curve (AUC) compared to state-of-the-art methods.


title: A Robust Model for Trust Evaluation during Interactions between Agents in a Sociable Environment

abstract: Trust evaluation is an important topic in both research and applications in sociable environments. This paper presents a model for trust evaluation between agents by the combination of direct trust, indirect trust through neighbouring links and the reputation of an agent in the environment (i.e. social network) to provide the robust evaluation. Our approach is typology independent from social network structures and in a decentralized manner without a central controller, so it can be used in broad domains.


title: Recursive input and state estimation: A general framework for learning from time series with missing data

abstract: Time series with missing data are signals encountered in important settings for machine learning. Some of the most successful prior approaches for modeling such time series are based on recurrent neural networks that transform the input and previous state to account for the missing observations, and then treat the transformed signal in a standard manner. In this paper, we introduce a single unifying framework, Recursive Input and State Estimation (RISE), for this general approach and reformulate existing models as specific instances of this framework. We then explore additional novel variations within the RISE framework to improve the performance of any instance. We exploit representation learning techniques to learn latent representations of the signals used by RISE instances. We discuss and develop various encoding techniques to learn latent signal representations. We benchmark instances of the framework with various encoding functions on three data imputation datasets, observing that RISE instances always benefit from encoders that learn representations for numerical values from the digits into which they can be decomposed.


title: Spheroidal Domains and Geometric Analysis in Euclidean Space

abstract: Clifford's geometric algebra has enjoyed phenomenal development over the last 60 years by mathematicians, theoretical physicists, engineers and computer scientists in robotics, artificial intelligence and data analysis, introducing a myriad of different and often confusing notations. The geometric algebra of Euclidean 3-space, the natural generalization of both the well-known Gibbs-Heaviside vector algebra, and Hamilton's quaternions, is used here to study spheroidal domains, spheroidal-graphic projections, the Laplace equation and its Lie algebra of symmetries. The Cauchy-Kovalevska extension and the Cauchy kernel function are treated in a unified way. The concept of a quasi-monogenic family of functions is introduced and studied.


title: ASBERT: Siamese and Triplet network embedding for open question answering

abstract: Answer selection (AS) is an essential subtask in the field of natural language processing with an objective to identify the most likely answer to a given question from a corpus containing candidate answer sentences. A common approach to address the AS problem is to generate an embedding for each candidate sentence and query. Then, select the sentence whose vector representation is closest to the query's. A key drawback is the low quality of the embeddings, hitherto, based on its performance on AS benchmark datasets. In this work, we present ASBERT, a framework built on the BERT architecture that employs Siamese and Triplet neural networks to learn an encoding function that maps a text to a fixed-size vector in an embedded space. The notion of distance between two points in this space connotes similarity in meaning between two texts. Experimental results on the WikiQA and TrecQA datasets demonstrate that our proposed approach outperforms many state-of-the-art baseline methods.


title: Abusing Cache Line Dirty States to Leak Information in Commercial Processors

abstract: Caches have been used to construct various types of covert and side channels to leak information. Most existing cache channels exploit the timing difference between cache hits and cache misses. However, we introduce a new and broader classification of cache covert channel attacks: Hit+Miss, Hit+Hit, and Miss+Miss. We highlight that cache misses for cache lines in different states may have more significant time differences, and these can be used as timing channels. Based on this classification, we propose a new stable and stealthy Miss+Miss cache channel. Write-back caches are widely deployed in modern processors. This paper presents in detail a way in which replacement latency differences can be used to construct timing-based channels (called WB channels) to leak information in a write-back cache. Any modification to a cache line by a sender will set it to the dirty state, and the receiver can observe this through measuring the latency of replacing this cache set. We also demonstrate how senders could exploit a different number of dirty cache lines in a cache set to improve transmission bandwidth with symbols encoding multiple bits. The peak transmission bandwidths of the WB channels in commercial systems can vary between 1300 and 4400~kbps per cache set in a hyper-threaded setting without shared memory between the sender and the receiver. In contrast to most existing cache channels, which always target specific memory addresses, the new WB channels focus on the cache set and cache line states, making it difficult for the channel to be disturbed by other processes on the core, and they can still work in a cache using a random replacement policy. We also analyzed the stealthiness of WB channels from the perspective of the number of cache loads and cache miss rates. We discuss and evaluate possible defenses. The paper finishes by discussing various forms of side-channel attack.


title: Mobile App Tasks with Iterative Feedback (MoTIF): Addressing Task Feasibility in Interactive Visual Environments

abstract: In recent years, vision-language research has shifted to study tasks which require more complex reasoning, such as interactive question answering, visual common sense reasoning, and question-answer plausibility prediction. However, the datasets used for these problems fail to capture the complexity of real inputs and multimodal environments, such as ambiguous natural language requests and diverse digital domains. We introduce Mobile app Tasks with Iterative Feedback (MoTIF), a dataset with natural language commands for the greatest number of interactive environments to date. MoTIF is the first to contain natural language requests for interactive environments that are not satisfiable, and we obtain follow-up questions on this subset to enable research on task uncertainty resolution. We perform initial feasibility classification experiments and only reach an F1 score of 37.3, verifying the need for richer vision-language representations and improved architectures to reason about task feasibility.


title: Conjectures on the distribution behavior of the class numbers of certain real quadratic number fields

abstract: Given a random real quadratic field from $\{ \mathbb{Q}(\sqrt{p}\,) ~|~ p \text{ primes} \}$, the conjectural probability $\mathbb{P}(h=q)$ that it has class number $q$ is given for all positive odd integers $q$. Some related conjectures of the Cohen-Lenstra heuristic are given here as corollaries. These results suggest that the set of real quadratic number fields may have some natural hierarchical structures.


title: On sizes of 1-cross intersecting set pair systems

abstract: Let $\{(A_i,B_i)\}_{i=1}^m$ be a set pair system. F\"{u}redi, Gy\'{a}rf\'{a}s and Kir\'{a}ly called it {\em $1$-cross intersecting} if $|A_i\cap B_j|$ is $1$ when $i\neq j$ and $0$ if $i=j$. They studied such systems and their generalizations, and in particular considered $m(a,b,1)$ -- the maximum size of a $1$-cross intersecting set pair system in which $|A_i|\leq a$ and $|B_i|\leq b$ for all $i$. F\"{u}redi, Gy\'{a}rf\'{a}s and Kir\'{a}ly proved that $m(n,n,1)\geq 5^{(n-1)/2}$ and asked whether there are upper bounds on $m(n,n,1)$ significantly better than the classical bound ${2n\choose n}$ of Bollob\' as for cross intersecting set pair systems. Answering one of their questions, Holzman recently proved that if $a,b\geq 2$, then $m(a,b,1)\leq \frac{29}{30}\binom{a+b}{a}$. He also conjectured that the factor $\frac{29}{30}$ in his bound can be replaced by $\frac{5}{6}$. The goal of this paper is to prove this bound.


title: Magnetohydrodynamic stability of magnetars in the ultrastrong field regime I: The core

abstract: We study magnetohydrodynamic stability of neutron star core matter composed of neutrons, protons and leptons threaded by a magnetar-strength magnetic field $10^{14}$--$10^{17}$ G, where quantum electrodynamical effects and Landau quantization of fermions are important. Stability is determined using the Friedman--Schutz formalism for the canonical energy of fluid perturbations, which we calculate for a magnetizable fluid with $H\neq B$. Using this and the Euler--Heisenberg--Fermi--Dirac Lagrangian for a strongly magnetized fluid of Landau-quantized charged fermions, we calculate the local stability criteria for a fluid slab as a stand-in for a segment of a neutron star core, accounting for magnetic and composition gradient buoyancy. The slab is threaded by a field orthogonal to the gravitational field, the Cartesian analogy to a toroidal field. We find that, for sufficiently strong fields $B\gtrsim10^{15}$ G, the magnetized fluid is unstable to a magnetosonic-type instability with growth times of order $10^{-3}$ s. The instability is triggered by sharp changes in the second-order field derivative of the Euler--Heisenberg--Fermi--Dirac Lagrangian which occur where additional Landau levels start being populated. These sharp changes are divergent at zero temperature, but are finite for nonzero temperature, so realistic neutron star core temperatures $5\times10^7$ K$<T<5\times10^8$ K are used. We conjecture that this mechanism could promote the formation of magnetic domains as predicted by Blandford and Hernquist (1982) and Suh and Mathews (2010).


title: A Novel Non-population-based Meta-heuristic Optimizer Inspired by the Philosophy of Yi Jing

abstract: Drawing inspiration from the philosophy of Yi Jing, Yin-Yang pair optimization (YYPO) has been shown to achieve competitive performance in single objective optimizations. Besides, it has the advantage of low time complexity when comparing to other population-based optimization. As a conceptual extension of YYPO, we proposed the novel Yi optimization (YI) algorithm as one of the best non-population-based optimizer. Incorporating both the harmony and reversal concept of Yi Jing, we replace the Yin-Yang pair with a Yi-point, in which we utilize the Levy flight to update the solution and balance both the effort of the exploration and the exploitation in the optimization process. As a conceptual prototype, we examine YI with IEEE CEC 2017 benchmark and compare its performance with a Levy flight-based optimizer CV1.0, the state-of-the-art dynamical Yin-Yang pair optimization in YYPO family and a few classical optimizers. According to the experimental results, YI shows highly competitive performance while keeping the low time complexity. Hence, the results of this work have implications for enhancing meta-heuristic optimizer using the philosophy of Yi Jing, which deserves research attention.


title: Optimal large time behavior of the compressible Bipolar Navier--Stokes--Poisson system with unequal viscosities

abstract: This paper is concerned with the Cauchy problem of the 3D compressible bipolar Navier--Stokes--Poisson (BNSP) system with unequal viscosities, and our main purpose is three--fold: First, under the assumption that $H^l\cap L^1$($l\geq 3$)--norm of the initial data is small, we prove the optimal time decay rates of the solution as well as its all--order spatial derivatives from one--order to the highest--order, which are the same as those of the compressible Navier--Stokes equations and the heat equation. Second, for well--chosen initial data, we also show the lower bounds on the decay rates. Therefore, our time decay rates are optimal. Third, we give the explicit influences of the electric field on the qualitative behaviors of solutions, which are totally new as compared to the results for the compressible unipolar Navier--Stokes--Poisson(UNSP) system [Li et al., in Arch. Ration. Mech. Anal., {196} (2010), 681--713; Wang, J. Differ. Equ., { 253} (2012), 273--297]. More precisely, we show that the densities of the BNSP system converge to their corresponding equilibriums at the same $L^2$--rate $(1+t)^{-\frac{3}{4}}$ as the compressible Navier--Stokes equations, but the momentums of the BNSP system and the difference between two densities decay at the $L^2$--rate $(1+t)^{-\frac{3}{2}(\frac{1}{p}-\frac{1}{2})}$ and $(1+t)^{-\frac{3}{2}(\frac{1}{p}-\frac{1}{2})-\frac{1}{2}}$ with $1\leq p\leq \frac{3}{2}$, respectively, which depend directly on the initial low frequency assumption of electric field, namely, the smallness of $\|\nabla \phi_0\|_{L^p}$.


title: Multiwavelength Study of the Quiescent States of Six Brightest Flat Spectrum Radio Quasars detected by Fermi-LAT

abstract: The regular monitoring of flat-spectrum radio quasars (FSRQs) in $\gamma$-rays by Fermi-LAT since past 12 years indicated six sources who exhibited extreme $\gamma$-ray outbursts crossing daily flux of $10^{-5}$ photons/cm$^{2}$/s. We obtained nearly-simultaneous multi-wavelength data of these sources in radio to $\gamma$-ray waveband from OVRO, Steward Observatory, SMARTS, Swift-UVOT, Swift-XRT, and Fermi-LAT. The time-averaged broadband Spectral Energy Distributions (SEDs) of these sources in quiescent states were studied to get an idea about the underlying baseline radiation processes. We modeled the SEDs using one-zone leptonic synchrotron and inverse-Compton emission scenario from broken power-law electron energy distribution inside a spherical plasma blob, relativistically moving down a conical jet. The model takes into account inverse-Compton scattering of externally and locally originated seed photons in the jet. The big blue bumps visible in quiescent state SEDs helped to estimate the accretion disk luminosities and central black hole masses. We found a correlation between the magnetic field inside the emission region and the ratio of emission region distance to disk luminosity, which implies that the magnetic field decreases with an increase in emission region distance and decrease in disk luminosity, suggesting a disk-jet connection. The high-energy index of the electron distribution was also found to be correlated with observed $\gamma$-ray luminosity as $\gamma$-rays are produced by high-energy particles. In most cases, kinetic power carried by electrons can account for jet radiation power as jets become radiatively inefficient during quiescent states.


title: Initial Newton polynomial of the discriminant

abstract: Let $(f,g)\colon (\mathbb{C}^2,0)\longrightarrow (\mathbb{C}^2,0)$ be a holomorphic mapping with an isolated zero. We show that the initial Newton polynomial of its discriminant is determined, up to rescalling variables, by the ideals $(f)$ and $(g)$.


title: Wide-Baseline Multi-Camera Calibration using Person Re-Identification

abstract: We address the problem of estimating the 3D pose of a network of cameras for large-environment wide-baseline scenarios, e.g., cameras for construction sites, sports stadiums, and public spaces. This task is challenging since detecting and matching the same 3D keypoint observed from two very different camera views is difficult, making standard structure-from-motion (SfM) pipelines inapplicable. In such circumstances, treating people in the scene as "keypoints" and associating them across different camera views can be an alternative method for obtaining correspondences. Based on this intuition, we propose a method that uses ideas from person re-identification (re-ID) for wide-baseline camera calibration. Our method first employs a re-ID method to associate human bounding boxes across cameras, then converts bounding box correspondences to point correspondences, and finally solves for camera pose using multi-view geometry and bundle adjustment. Since our method does not require specialized calibration targets except for visible people, it applies to situations where frequent calibration updates are required. We perform extensive experiments on datasets captured from scenes of different sizes, camera settings (indoor and outdoor), and human activities (walking, playing basketball, construction). Experiment results show that our method achieves similar performance to standard SfM methods relying on manually labeled point correspondences.


title: RefineMask: Towards High-Quality Instance Segmentation with Fine-Grained Features

abstract: The two-stage methods for instance segmentation, e.g. Mask R-CNN, have achieved excellent performance recently. However, the segmented masks are still very coarse due to the downsampling operations in both the feature pyramid and the instance-wise pooling process, especially for large objects. In this work, we propose a new method called RefineMask for high-quality instance segmentation of objects and scenes, which incorporates fine-grained features during the instance-wise segmenting process in a multi-stage manner. Through fusing more detailed information stage by stage, RefineMask is able to refine high-quality masks consistently. RefineMask succeeds in segmenting hard cases such as bent parts of objects that are over-smoothed by most previous methods and outputs accurate boundaries. Without bells and whistles, RefineMask yields significant gains of 2.6, 3.4, 3.8 AP over Mask R-CNN on COCO, LVIS, and Cityscapes benchmarks respectively at a small amount of additional computational cost. Furthermore, our single-model result outperforms the winner of the LVIS Challenge 2020 by 1.3 points on the LVIS test-dev set and establishes a new state-of-the-art. Code will be available at https://github.com/zhanggang001/RefineMask.


title: Crossing the Conversational Chasm: A Primer on Natural Language Processing for Multilingual Task-Oriented Dialogue Systems

abstract: In task-oriented dialogue (ToD), a user holds a conversation with an artificial agent to complete a concrete task. Although this technology represents one of the central objectives of AI and has been the focus of ever more intense research and development efforts, it is currently limited to a few narrow domains (e.g., food ordering, ticket booking) and a handful of languages (e.g., English, Chinese). This work provides an extensive overview of existing methods and resources in multilingual ToD as an entry point to this exciting and emerging field. We find that the most critical factor preventing the creation of truly multilingual ToD systems is the lack of datasets in most languages for both training and evaluation. In fact, acquiring annotations or human feedback for each component of modular systems or for data-hungry end-to-end systems is expensive and tedious. Hence, state-of-the-art approaches to multilingual ToD mostly rely on (zero- or few-shot) cross-lingual transfer from resource-rich languages (almost exclusively English), either by means of machine translation or multilingual representations. These approaches are currently viable only for typologically similar languages and languages with parallel / monolingual corpora available. On the other hand, their effectiveness beyond these boundaries is doubtful or hard to assess due to the lack of linguistically diverse benchmarks (especially for natural language generation and end-to-end evaluation). To overcome this limitation, we draw parallels between components of the ToD pipeline and other NLP tasks, which can inspire solutions for learning in low-resource scenarios. Finally, we list additional challenges that multilinguality poses for related areas (such as speech and human-centred evaluation), and indicate future directions that hold promise to further expand language coverage and dialogue capabilities of current ToD systems.


title: Ripple : Simplified Large-Scale Computation on Heterogeneous Architectures with Polymorphic Data Layout

abstract: GPUs are now used for a wide range of problems within HPC. However, making efficient use of the computational power available with multiple GPUs is challenging. The main challenges in achieving good performance are memory layout, affecting memory bandwidth, effective use of the memory spaces with a GPU, inter-GPU communication, and synchronization. We address these problems with the Ripple library, which provides a unified view of the computational space across multiple dimensions and multiple GPUs, allows polymorphic data layout, and provides a simple graph interface to describe an algorithm from which inter-GPU data transfers can be optimally scheduled. We describe the abstractions provided by Ripple to allow complex computations to be described simply, and to execute efficiently across many GPUs with minimal overhead. We show performance results for a number of examples, from particle motion to finite-volume methods and the eikonal equation, as well as showing good strong and weak scaling results across multiple GPUs.


title: On Learning the Geodesic Path for Incremental Learning

abstract: Neural networks notoriously suffer from the problem of catastrophic forgetting, the phenomenon of forgetting the past knowledge when acquiring new knowledge. Overcoming catastrophic forgetting is of significant importance to emulate the process of "incremental learning", where the model is capable of learning from sequential experience in an efficient and robust way. State-of-the-art techniques for incremental learning make use of knowledge distillation towards preventing catastrophic forgetting. Therein, one updates the network while ensuring that the network's responses to previously seen concepts remain stable throughout updates. This in practice is done by minimizing the dissimilarity between current and previous responses of the network one way or another. Our work contributes a novel method to the arsenal of distillation techniques. In contrast to the previous state of the art, we propose to firstly construct low-dimensional manifolds for previous and current responses and minimize the dissimilarity between the responses along the geodesic connecting the manifolds. This induces a more formidable knowledge distillation with smooth properties which preserves the past knowledge more efficiently as observed by our comprehensive empirical study.


title: On links in $S_{g} \times S^{1}$ and its invariants

abstract: A virtual knot, which is one of generalizations of knots in $\mathbb{R}^{3}$ (or $S^{3}$), is, roughly speaking, an embedded circle in thickened surface $S_{g} \times I$. In this talk we will discuss about knots in 3 dimensional $S_{g} \times S^{1}$. We introduce basic notions for knots in $S_{g} \times S^{1}$, for example, diagrams, moves for diagrams and so on. For knots in $S_{g} \times S^{1}$ technically we lose over/under information, but we will have information how many times the knot rotates along $S^{1}$. We will discuss the geometric meaning of the rotating information and how to construct invariants by using the "rotating" information.


title: Hole probability for noninteracting fermions in a $d$-dimensional trap

abstract: The hole probability, i.e., the probability that a region is void of particles, is a benchmark of correlations in many body systems. We compute analytically this probability $P(R)$ for a spherical region of radius $R$ in the case of $N$ noninteracting fermions in their ground state in a $d$-dimensional trapping potential. Using a connection to the Laguerre-Wishart ensembles of random matrices, we show that, for large $N$ and in the bulk of the Fermi gas, $P(R)$ is described by a universal scaling function of $k_F R$, for which we obtain an exact formula ($k_F$ being the local Fermi wave-vector). It exhibits a super exponential tail $P(R)\propto e^{- \kappa_d (k_F R)^{d+1}}$ where $\kappa_d$ is a universal amplitude, in good agreement with existing numerical simulations. When $R$ is of the order of the radius of the Fermi gas, the hole probability is described by a large deviation form which is not universal and which we compute exactly for the harmonic potential. Similar results also hold in momentum space.

categories: cond-mat.stat-mech math-ph math.MP math.PR


title: VSpSR: Explorable Super-Resolution via Variational Sparse Representation

abstract: Super-resolution (SR) is an ill-posed problem, which means that infinitely many high-resolution (HR) images can be degraded to the same low-resolution (LR) image. To study the one-to-many stochastic SR mapping, we implicitly represent the non-local self-similarity of natural images and develop a Variational Sparse framework for Super-Resolution (VSpSR) via neural networks. Since every small patch of a HR image can be well approximated by the sparse representation of atoms in an over-complete dictionary, we design a two-branch module, i.e., VSpM, to explore the SR space. Concretely, one branch of VSpM extracts patch-level basis from the LR input, and the other branch infers pixel-wise variational distributions with respect to the sparse coefficients. By repeatedly sampling coefficients, we could obtain infinite sparse representations, and thus generate diverse HR images. According to the preliminary results of NTIRE 2021 challenge on learning SR space, our team (FudanZmic21) ranks 7-th in terms of released scores. The implementation of VSpSR is released at https://zmiclab.github.io/.


title: Microlocal analysis of the light ray transform on globally hyperbolic Lorentzian manifolds

abstract: For the light ray transform on globally hyperbolic Lorentzian manifolds of dimension $n+1 \geq 3$ acting on compactly supported distributions, we show that the Schwartz kernel of the normal operator is a paired Lagrangian distribution with non-vanishing principal symbols on each Lagrangians. We obtain Sobolev estimates for the light ray transform, and clarify the determination of light-like singularities using the normal operator.


title: Manipulating Hubbard-type Coulomb blockade effect of metallic wires embedded in an insulator

abstract: Correlated states emerge in low-dimensional systems owing to enhanced Coulomb interactions. Elucidating these states requires atomic scale characterization and delicate control capabilities. In this study, spectroscopic imaging-scanning tunneling microscopy was employed to investigate the correlated states residing in the one-dimensional electrons of the monolayer and bilayer MoSe2 mirror twin boundary (MTB). The Coulomb energies, determined by the wire length, drive the MTB into two types of ground states with distinct respective out-of-phase and in-phase charge orders. The two ground states can be reversibly converted through a metastable zero-energy state with in situ voltage pulses, which tunes the electron filling of the MTB via a polaronic process, as substantiated by first-principles calculations. Our modified Hubbard model reveals the ground states as correlated insulators from an on-site U-originated Coulomb interaction, dubbed Hubbard-type Coulomb blockade effect. Our work sets a foundation for understanding correlated physics in complex systems and for tailoring quantum states for nano-electronics applications.


title: GupShup: An Annotated Corpus for Abstractive Summarization of Open-Domain Code-Switched Conversations

abstract: Code-switching is the communication phenomenon where speakers switch between different languages during a conversation. With the widespread adoption of conversational agents and chat platforms, code-switching has become an integral part of written conversations in many multi-lingual communities worldwide. This makes it essential to develop techniques for summarizing and understanding these conversations. Towards this objective, we introduce abstractive summarization of Hindi-English code-switched conversations and develop the first code-switched conversation summarization dataset - GupShup, which contains over 6,831 conversations in Hindi-English and their corresponding human-annotated summaries in English and Hindi-English. We present a detailed account of the entire data collection and annotation processes. We analyze the dataset using various code-switching statistics. We train state-of-the-art abstractive summarization models and report their performances using both automated metrics and human evaluation. Our results show that multi-lingual mBART and multi-view seq2seq models obtain the best performances on the new dataset


title: SelectVisAR: Selective Visualisation of Virtual Environments in Augmented Reality

abstract: When establishing a visual connection between a virtual reality user and an augmented reality user, it is important to consider whether the augmented reality user faces a surplus of information. Augmented reality, compared to virtual reality, involves two, not one, planes of information: the physical and the virtual. We propose SelectVisAR, a selective visualisation system of virtual environments in augmented reality. Our system enables an augmented reality spectator to perceive a co-located virtual reality user in the context of four distinct visualisation conditions: Interactive, Proximity, Everything, and Dollhouse. We explore an additional two conditions, Context and Spotlight, in a follow-up study. Our design uses a human-centric approach to information filtering, selectively visualising only parts of the virtual environment related to the interactive possibilities of a virtual reality user. The research investigates how selective visualisations can be helpful or trivial for the augmented reality user when observing a virtual reality user.


title: Uncovering audio patterns in music with Nonnegative Tucker Decomposition for structural segmentation

abstract: Recent work has proposed the use of tensor decomposition to model repetitions and to separate tracks in loop-based electronic music. The present work investigates further on the ability of Nonnegative Tucker Decompositon (NTD) to uncover musical patterns and structure in pop songs in their audio form. Exploiting the fact that NTD tends to express the content of bars as linear combinations of a few patterns, we illustrate the ability of the decomposition to capture and single out repeated motifs in the corresponding compressed space, which can be interpreted from a musical viewpoint. The resulting features also turn out to be efficient for structural segmentation, leading to experimental results on the RWC Pop data set which are potentially challenging state-of-the-art approaches that rely on extensive example-based learning schemes.


title: Color Variants Identification in Fashion e-commerce via Contrastive Self-Supervised Representation Learning

abstract: In this paper, we utilize deep visual Representation Learning to address an important problem in fashion e-commerce: color variants identification, i.e., identifying fashion products that match exactly in their design (or style), but only to differ in their color. At first we attempt to tackle the problem by obtaining manual annotations (depicting whether two products are color variants), and train a supervised triplet loss based neural network model to learn representations of fashion products. However, for large scale real-world industrial datasets such as addressed in our paper, it is infeasible to obtain annotations for the entire dataset, while capturing all the difficult corner cases. Interestingly, we observed that color variants are essentially manifestations of color jitter based augmentations. Thus, we instead explore Self-Supervised Learning (SSL) to solve this problem. We observed that existing state-of-the-art SSL methods perform poor, for our problem. To address this, we propose a novel SSL based color variants model that simultaneously focuses on different parts of an apparel. Quantitative and qualitative evaluation shows that our method outperforms existing SSL methods, and at times, the supervised model.


title: Eigenstate properties of the disordered Bose-Hubbard chain

abstract: Many-body localization (MBL) of a disordered interacting boson system in one dimension is studied numerically at the filling faction one-half. The von Neumann entanglement entropy SvN is commonly used to detect the MBL phase transition but remains challenging to be directly measured. Based on the U(1) symmetry from the particle number conservation, SvN can be decomposed into the particle number entropy SN and the configuration entropy SC. In light of the tendency that the eigenstate's SC nears zero in the localized phase, we introduce a quantity describing the deviation of SN from the ideal thermalization distribution; finite-size scaling analysis illustrates that it shares the same phase transition point with SvN but displays the better critical exponents. This observation hints that the phase transition to MBL might largely be determined by SN and its fluctuations. Notably, the recent experiments [A. Lukin et al., Science 364, 256 (2019); J. Leonard et al., Nat. Phys. 19, 481 (2023)] demonstrated that this deviation can potentially be measured through the SN measurement. Furthermore, our investigations reveal that the thermalized states primarily occupy the low-energy section of the spectrum, as indicated by measures of localization length, gap ratio, and energy density distribution. This low-energy spectrum of the Bose model closely resembles the entire spectrum of the Fermi (or spin XXZ) model, accommodating a transition from the thermalized to the localized states. While, owing to the bosonic statistics, the high-energy spectrum of the model allows the formation of distinct clusters of bosons in the random potential background. We analyze the resulting eigenstate properties and briefly summarize the associated dynamics. To distinguish between the phase regions at the low and high energies, a probing quantity based on the structure of SvN is also devised.


title: The Logical Theory of Canonical Maps: The Elements & Distinctions Analysis of the Morphisms, Duality, Canonicity, and Universal Constructions in Set

abstract: Category theory gives a mathematical characterization of naturality but not of canonicity. The purpose of this paper is to develop the logical theory of canonical maps based on the broader demonstration that the dual notions of elements & distinctions are the basic analytical concepts needed to unpack and analyze morphisms, duality, canonicity, and universal constructions in Set, the category of sets and functions. The analysis extends directly to other Set-based concrete categories (groups, rings, vector spaces, etc.). Elements and distinctions are the building blocks of the two dual logics, the Boolean logic of subsets and the logic of partitions. The partial orders (inclusion and refinement) in the lattices for the dual logics define the canonical morphisms (where `canonical' is always relative to the given data, not an absolute property of a morphism). The thesis is that the maps that are canonical in Set are the ones that are defined (given the data of the situation) by these two logical partial orders and by the compositions of those maps.


title: Deep Learning in Beyond 5G Networks with Image-based Time-Series Representation

abstract: Towards the network innovation, the Beyond Five-Generation (B5G) networks envision the use of machine learning (ML) methods to predict the network conditions and performance indicators in order to best make decisions and allocate resources. In this paper, we propose a new ML approach to accomplish predictions in B5G networks. Instead of handling the time-series in the network domain of values, we transform them into image thus allowing to apply advanced ML methods of Computer Vision field to reach better predictions in B5G networks. Particularly, we analyze different techniques to transform time-series of network measures into image representation, e.g., Recurrence Plots, Markov Transition Fields, and Gramian Angular Fields. Then, we apply deep neural networks with convolutional layers to predict different 5G radio signal quality indicators. When comparing with other ML-based solutions, experimental results from 5G transmission datasets showed the feasibility and small prediction errors of the proposed approach.


title: Age Range Estimation using MTCNN and VGG-Face Model

abstract: The Convolutional Neural Network has amazed us with its usage on several applications. Age range estimation using CNN is emerging due to its application in myriad of areas which makes it a state-of-the-art area for research and improve the estimation accuracy. A deep CNN model is used for identification of people's age range in our proposed work. At first, we extracted only face images from image dataset using MTCNN to remove unnecessary features other than face from the image. Secondly, we used random crop technique for data augmentation to improve the model performance. We have used the concept of transfer learning in our research. A pretrained face recognition model i.e VGG-Face is used to build our model for identification of age range whose performance is evaluated on Adience Benchmark for confirming the efficacy of our work. The performance in test set outperformed existing state-of-the-art by substantial margins.


title: Optimizing Furnace efficiency for Factory of Future using Cooperative Games

abstract: Approximately 75% of energy used in petrochemical and refining industries is consumed by furnaces. Operating furnaces at optimal conditions results in huge amounts of savings. In this paper, we model the furnace efficiency optimization as a multi-objective problem involving multiple interactions among the controlled variables and propose a cooperative game based formulation for the factory of future. The controlled variables are Absorbed Duty and Coil Outlet Temperature. We propose a comprehensive solution to select the best combination of manipulated variables (fired duty, throughput and coil inlet temperature) satisfying multiple criteria using a cooperative game theory approach. We compare this approach with the standard multi-objective optimization using NSGA-II and RNSGA-II algorithms.


title: The Relative Importance of Faraday Rotation and QED Birefringence for the Linear Polarization of X-rays from Mass Accreting Black Holes

abstract: The upcoming IXPE (2-8 keV) and XL-Calibur (15-75 keV) missions will make it possible to measure the linear polarization of X-rays from mass accreting stellar mass black holes with unprecedented sensitivity, enabling the accurate measurement of percent-level and in some cases even sub-percent level polarization fractions. The measurements are expected to constrain the spins, inclinations, and the structure of the accretion flows of the observed black holes. The effects of Faraday rotation and birefringence of the Quantum Electrodynamics (QED) vacuum may impact the observable polarization fractions and angles, complicating the interpretation of the results. We estimate the importance of both effects for X-rays from stellar mass and supermassive black holes and discuss the implications of the results for the upcoming IXPE and XL-Calibur observations.


title: Sentence Alignment with Parallel Documents Facilitates Biomedical Machine Translation

abstract: Objective: Today's neural machine translation (NMT) can achieve near human-level translation quality and greatly facilitates international communications, but the lack of parallel corpora poses a key problem to the development of translation systems for highly specialized domains, such as biomedicine. This work presents an unsupervised algorithm for deriving parallel corpora from document-level translations by using sentence alignment and explores how training materials affect the performance of biomedical NMT systems. Materials and Methods: Document-level translations are mixed to train bilingual word embeddings (BWEs) for the evaluation of cross-lingual word similarity, and sentence distance is defined by combining semantic and positional similarities of the sentences. The alignment of sentences is formulated as an extended earth mover's distance problem. A Chinese-English biomedical parallel corpus is derived with the proposed algorithm using bilingual articles from UpToDate and translations of PubMed abstracts, which is then used for the training and evaluation of NMT. Results: On two manually aligned translation datasets, the proposed algorithm achieved accurate sentence alignment in the 1-to-1 cases and outperformed competing algorithms in the many-to-many cases. The NMT model fine-tuned on biomedical data significantly improved the in-domain translation quality (zh-en: +17.72 BLEU; en-zh: +17.02 BLEU). Both the size of the training data and the combination of different corpora can significantly affect the model's performance. Conclusion: The proposed algorithm relaxes the assumption for sentence alignment and effectively generates accurate translation pairs that facilitate training high quality biomedical NMT models.


title: Hunting for states in the recent LHCb di-$J/\psi$ invariant mass spectrum

abstract: Partial wave analysis is performed, with effective potentials as dynamical inputs, to scrutinize the recent LHCb data on the di-$J/\psi$ invariant mass spectrum. Coupled-channel effects are incorporated in the production amplitude via final state interactions. The LHCb data can be well described. A dynamical generated pole structure, which can be identified as the $X(6900)$ state, is found. Our analysis also provides hints for the existence of three other possible states: a bound state $X(6200)$, a broad resonant state $X(6680)$ and a narrow resonant state $X(7200)$. The $J^{PC}$ quantum numbers of the $X(6680)$ and $X(6900)$ states should be $2^{++}$, while the $X(6200)$ and $X(7200)$ states prefer $0^{++}$. To determine the above states more precisely, more experimental data for the channels, such as $J/\psi\psi(2S)$, $J/\psi\psi(3770)$, di-$\psi(2S)$, are required.


title: H$^2-$ Korn's Inequality and the Nonconforming Elements for The Strain Gradient Elastic Model

abstract: We establish a new H2 Korn's inequality and its discrete analog, which greatly simplify the construction of nonconforming elements for a linear strain gradient elastic model. The Specht triangle [41] and the NZT tetrahedron [45] are analyzed as two typical representatives for robust nonconforming elements in the sense that the rate of convergence is independent of the small material parameter. We construct new regularized interpolation estimate and the enriching operator for both elements, and prove the error estimates under minimal smoothness assumption on the solution. Numerical results are consistent with the theoretical prediction.


title: Analyzing admissions metrics as predictors of graduate GPA and whether graduate GPA mediates PhD completion

abstract: An analysis of 1,955 physics graduate students from 19 PhD programs shows that undergraduate grade point average predicts graduate grades and PhD completion more effectively than GRE scores. Students' undergraduate GPA (UGPA) and GRE Physics (GRE-P) scores are small but statistically significant predictors of graduate course grades, while GRE quantitative and GRE verbal scores are not. We also find that males and females score equally well in their graduate coursework despite a statistically significant 18 percentile point gap in median GRE-P scores between genders. A counterfactual mediation analysis demonstrates that among admission metrics tested only UGPA is a significant predictor of overall PhD completion, and that UGPA predicts PhD completion indirectly through graduate grades. Thus UGPA measures traits linked to graduate course grades, which in turn predict graduate completion. Although GRE-P scores are not significantly associated with PhD completion, our results suggest that any predictive effect they may have are also linked indirectly through graduate GPA. Overall our results indicate that among commonly used quantitative admissions metrics, UGPA offers the most insight into two important measures of graduate school success, while posing fewer concerns for equitable admissions practices.


title: New Technology, New Rules for Journalism and a New World of Engagement

abstract: The ways in which people learn, communicate and engage in discussion have changed profoundly during the past decade. As Jenkins related in her book, The Convergence Crisis: An Impending Paradigm Shift in Advertising, Millenials do not want to be told the whole story. Rather, they want someone to begin a conversation that will engage others to become participants in the development of that story (2015). Technology now allows that to happen, sometimes with unintended and/or ill consequences, but technology also generates a dynamic potential to create international and interactive discourse aimed at addressing shared global challenges.


title: SoK: Design Tools for Side-Channel-Aware Implementations

abstract: Side-channel attacks that leak sensitive information through a computing device's interaction with its physical environment have proven to be a severe threat to devices' security, particularly when adversaries have unfettered physical access to the device. Traditional approaches for leakage detection measure the physical properties of the device. Hence, they cannot be used during the design process and fail to provide root cause analysis. An alternative approach that is gaining traction is to automate leakage detection by modeling the device. The demand to understand the scope, benefits, and limitations of the proposed tools intensifies with the increase in the number of proposals. In this SoK, we classify approaches to automated leakage detection based on the model's source of truth. We classify the existing tools on two main parameters: whether the model includes measurements from a concrete device and the abstraction level of the device specification used for constructing the model. We survey the proposed tools to determine the current knowledge level across the domain and identify open problems. In particular, we highlight the absence of evaluation methodologies and metrics that would compare proposals' effectiveness from across the domain. We believe that our results help practitioners who want to use automated leakage detection and researchers interested in advancing the knowledge and improving automated leakage detection.


title: Proportionality and Strategyproofness in Multiwinner Elections

abstract: Multiwinner voting rules can be used to select a fixed-size committee from a larger set of candidates. We consider approval-based committee rules, which allow voters to approve or disapprove candidates. In this setting, several voting rules such as Proportional Approval Voting (PAV) and Phragm\'en's rules have been shown to produce committees that are proportional, in the sense that they proportionally represent voters' preferences; all of these rules are strategically manipulable by voters. On the other hand, a generalisation of Approval Voting gives a non-proportional but strategyproof voting rule. We show that there is a fundamental tradeoff between these two properties: we prove that no multiwinner voting rule can simultaneously satisfy a weak form of proportionality (a weakening of justified representation) and a weak form of strategyproofness. Our impossibility is obtained using a formulation of the problem in propositional logic and applying SAT solvers; a human-readable version of the computer-generated proof is obtained by extracting a minimal unsatisfiable set (MUS). We also discuss several related axiomatic questions in the domain of committee elections.


title: Mixed Effect Modeling and Variable Selection for Quantile Regression

abstract: It is known that the estimating equations for quantile regression (QR) can be solved using an EM algorithm in which the M-step is computed via weighted least squares, with weights computed at the E-step as the expectation of independent generalized inverse-Gaussian variables. This fact is exploited here to extend QR to allow for random effects in the linear predictor. Convergence of the algorithm in this setting is established by showing that it is a generalized alternating minimization (GAM) procedure. Another modification of the EM algorithm also allows us to adapt a recently proposed method for variable selection in mean regression models to the QR setting. Simulations show the resulting method significantly outperforms variable selection in QR models using the lasso penalty. Applications to real data include a frailty QR analysis of hospital stays, and variable selection for age at onset of lung cancer and for riboflavin production rate using high-dimensional gene expression arrays for prediction.


title: The Bateman Functions Revisited After 90 Years -- A Survey of Old and New Results

abstract: The Bateman functions and the allied Havelock functions were introduced as solutions of some problems in hydrodynamics about ninety years ago, but after a period of one or two decades they were practically neglected. In handbooks, the Bateman function is only mentioned as a particular case of the confluent hypergeometric function. In order to revive our knowledge on these functions their basic properties (recurrence functional and differential relations, series, integrals and the Laplace transforms) are presented. Some new results are also included. Special attention is directed to the Bateman and Havelock functions with integer orders, to known in the literature generalizations of these functions and to the Bateman-integral function.


title: XLEnt: Mining a Large Cross-lingual Entity Dataset with Lexical-Semantic-Phonetic Word Alignment

abstract: Cross-lingual named-entity lexica are an important resource to multilingual NLP tasks such as machine translation and cross-lingual wikification. While knowledge bases contain a large number of entities in high-resource languages such as English and French, corresponding entities for lower-resource languages are often missing. To address this, we propose Lexical-Semantic-Phonetic Align (LSP-Align), a technique to automatically mine cross-lingual entity lexica from mined web data. We demonstrate LSP-Align outperforms baselines at extracting cross-lingual entity pairs and mine 164 million entity pairs from 120 different languages aligned with English. We release these cross-lingual entity pairs along with the massively multilingual tagged named entity corpus as a resource to the NLP community.